DOCUMENT RESUME 



ED 394 442 



HE 029 136 



AUTHOR 

TITLE 



INSTITUTION 



SPONS AGENCY 

REPORT NO 
PUB DATE 
CONTRACT 
NOTE 

AVAILABLE FROM 



PUB TYPE 



Gardiner, Lion F. 

Redesigning Higher Education; Producing Dramatic 
Gains in Student Learning. ASHE-ERIC Higher Education 
Report No. 7. 

Association for the Study of Higher Education.: ERIC 
Clearinghouse on Higher Education, Washington, D.C.; 
George Washington Univ. , Washington, DC. Graduate 
School of Education and Human Development.; New 
Jersey Inst, for Collegiate Teaching and Learning, 
South Orange. 

Office of Educational Research and Improvement (ED), 
Washington, DC. 

ISBN-1-878380-63-X; ISSN-0884-0040 
94 

ED-RR-93-002008 

233p.; For a digest of this report, see HE 029 
135. 

ERIC Clearinghouse on Higher Education, One Dupont 
Circle, N.W., Suite 630, Washington, DC 20036-1183 
($18 plus $3.75 postage). 

Information Analyses - ERIC Clearinghouse Products 
(071) 



EDRS PRICE MFOI/PCIO Plus Postage. 

DESCRIPTORS ’’'Academic Advising; Achievement Gains; *College 

Curriculum; *College Instruction; College Outcomes 
Assessment; Competency Based Education; *Educational 
Environment; ^Educational Quality; Evaluation 
Methods; Grading; Higher Education; *Instruct ional 
Effectiveness; Knowledge Level; Minimum Competencies; 
Organizational Climate; Outcomes of Education; 

Student Development; Student Evaluation 

ABSTRACT 

This monograph reviews empirical studies on various 
aspects of higher education relating to the effectiveness of 
instruction in regard to four areas: curriculum, instruction, campus 
psychological climate, and academic advising. After an introduction, 
the first section describes the development of critical skills, how 
these skills develop, and the conditions believed necessary to 
produce them. The following four sections examine the four core areas 
central to student development and the contribution research suggests 
they now make to the development: (1) curriculuii. (methods, the 
intellectual climate of the classroom, students' involvement, effects 
of the curriculum); (2) instruction (classroom te' '’s and grades); (3) 
the campus climate (integration into the campus community, commuter 
and part-time students, students involvement with faculty, and 
minority group members); and (4) academic advising (developmental 
advising, the necessity for training in advising, and evaluation, 
recognition, and reward of advising). The next three sections 
describe opportunities for dramatic gains in students' learning, 
examining evidence about the relative capacity of students to learn 
at a very high level; describing seven specific changes which can 
improve students' learning, and addressing issues of leadership, 
management, and professional development. The final section presents 
a vision and a challenge to develop a new kind of community on 

campus. (Contains approximately 650 references.) (DB) 



ED 394 442 



1994 Report Seven 

ASHE-ERIC Higher Education Reports 



Redesigning Higher Education 

Producing Dramatic Gains in Student Learning | 




2 



BEST COPY AVAILABLE 



Redesigning Higher Education: 

Producing Dramatic Gains in Student Learning 

b}' Lion F. Gardiner 

ASHE’FRICHigher Fdiication Report 1994 




-■ 




New Jersey Institute 
fur Collegiate 
Teaching and U^aming 



This report is a special cooperative project 
between the Sew Jersey Institute for Collegiate Teaching 
and Learning and the ERIC Clearinghouse on Higher Education 



Prepared by 







Clearinghouse on Higher Education 
The George Washington University* 



In cooperation with 

mm 



Association for the Study 
of Higher Education 



Published by 




Graduate School of Education and 
Human Development 
The George Washington Unit*ersity 



Jonathan D. Fife, Series Editor 



Cite as 

Gardiner, Lion ¥. Redesigning Higher Education: Producing 
Dtumaiic Gains in Student Learning. Report No. 7. Wash- 
ington, D.C.: Graduate School of Education and Human 
Development, The George Washington University, 1994. 

Library of Congress Catalog Card Number 96-75971 
ISSN 0884-0040 
ISBN 1-878380-63-X 

Managing Editor: Lynne J. Scott 

Manuscript Editor: Barbara J. Eishel/Editech 

Coiner design by Michael David Brown, Rockville, Maryland 



'Fhe ERIC Clearinghouse on Higher Educ'ation invites individu- 
als to submit proposals for writing monographs for the ASHE- 
ERIC Higher Education Report series. Proposals must include: 

1. A detailed manuscript proposal of not more than five pages. 

2. A chapter-by-chapter outline. 

3. A 75“Word summary to be used by several review com- 
mittees for the initial screening and rating of each proposal. 

4. A vita and a writing sample. 

iEHicl Clearinghouse on Higher Education 

Graduate School of Education and Human Development 
The George Washington University 
One Dupont Circle, Suite 630 
Washington, DC 20036-1183 

This publication was prepared partially with funding from tlie 
Office of Educational Research and Improvement, U.S. 
Department of Education, under contraa no. ED RR-93-002008. 
'fhe opinions e^' pressed in this report do not necessarily reflect 
the positioas or policies of OERI or the Department. 




4 




EXECUTIVE SUMMARY 



Since the late 1960s and early 1970s, American colleges and 
universities have been profoundly changed by the huge 
influx of “nontraditional” students who have increasingly 
characterized our campuses — women, people of color, and 
part-time and older students. These “new” students are far 
more representative ol Americans as a whole than were 
their predecessors. They are often less well prepared for 
college than their relatively more privileged peers, and the 
goals to wnich they aspire, their styles of learning, and 
their educational needs often differ from those of more tra- 
ditional students. Projections suggest our students v\ iil con- 
tinue to increase in diversity far into the future. 

A series of critical reports by authorities on higher educa- 
tion, political leaders, and businesspeople, published since 
the mid-1980s, have claimed that we in higher education 
have not responded effectively to the needs of our students 
of the last 25 years and that many of our graduates’ IcnowT 
edge and skills do not meet society’s requirements for well- 
educated citizens. 

How valid are these claims? How effectively are we edu- 
cating our students? because relatively few colleges or uni- 
versities broadly assess what their graduates know and are 
able to do, we have limited evidence with which to answer 
these now-urgent questions, and no comprehensive state- 
wide or natUmal assessment exists that might provide this 
evidence. Tlie research literature of higher education, how- 
ever, now contains many valual:>le findings, albeit widely 
scattered, that can help us answer these questions and pro- 
vide essential guidance to significantly improve our stu- 
dents' learning. Higher Ed uccit km gathers the 

findings of many ot these studies to make them readily 
accessible. 

What Are the Critical Competencies and 
How Do They Develop? 

Scholars and leaders in business and government most fre- 
quently identify the skills and dis|X)sitions essential to soci- 
ety’s economic and democratic success to include the 
capacities for critical thinking and complex problem solv- 
ing, respect for people different from oneself, principled 
ethical behavior, lifelong learning, and effective interper 
scmal interaction and teamwork. These crucial skills and 
dispositions presuppose cognitive abilities studies have 
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shown arc pocjrly developed in many college and univer- 
sity students. These underpinnings of advanced intellectual 
perlormance, as well as effective interpersonal interaction 
and teamwork, require for their dev'elopment continuous 
active involvement in learning and with other students and 
faculty, together with regular assessment and timely feed- 
back on performance. 

What Are the Effects of Our Curricxila? 

I'he limited research on curriculum is increasingly useful, 
Altlu)ugh our 3,600 colleges and universities differ in many 
(Jtlier ways, over 90 percent use distribution systems of cur- 
ricLilum, in which students select courses from lists, often 
witii c'onsiderable div^ersity of choice. Research reveals that 
nicm and women take significantly' different courses, that 
groLif)s of courses are correlated with gains, or declines, in 
specific competencies for groups of high- and low-ability 
students, a, id that student outcomes are not necessarily 
related to required courses, TIuis, research has questioned 
the developmental value of distributional curricula; curric- 
ula need to I)e adapted to tlie specific needs of different 
stLid^^ ius, Ty'pes and breadth of courses available, specific 
courses in the curriculum, and degree of choice may make 
relatively little difference in educational outcomes, although 
a tme-core curriculum, found in a few institutions, can be 
positively associated with many valued outcomes. How an 
institution provides its curricula can be more important 
than its curricular structure and content. 

Studies • Mggest, overall, that undergraduate liberal arts 
curricula tend to lack coherence and have limited breadth 
and depth, A liberal arts emphasis, however, as compared 
with more vocationally oriented curricula, can increase 
women’s choice of gender atypical careers and African- 
Arnerican males’ choice of higher pre,stige, typically major- 
ity careers, reduce authoritarianism, and increase capacity 
for principled ethical reasoning. 

How Effectively Do Our Courses Develop 
Students’ Intellectual Abilities? 

faculty' aspire to develop .students’ thinking skills, but re- 
search consistently shows that in practice we tend to aim at 
facts and concepts in tile disciplines, at the lowe.si cognitive 
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levels, rather than development of intellect or values. Nu- 
merous studies of college classrooms reveal that, rather 
than actively involving our students in learning, we lec- 
ture, even though lectures are not nearly as effective as 
other means for developing cognitive skills. In addition, 
students may he attending to lectures only about one-half 
of their time in class, and retention of information from 
lectures is low. 

Studies suggest our methods often fail to dislodge stu- 
dents’ misconceptions and ensure learning of complex, 
abstract concepts. Capacity for problem solving is limited 
by our use of inappropriately simple practice exercises. 

How Hard Do Students Work? 

Although quality of effort is key to accomplishment, studies 
consistently show that students generally study far less than 
necessary to learn effectively, although in many cases they 
have considerable di; retionary time. The limited evidence 
available on college outcomes reveals disappointing levels 
of knowledge and skills among students, consistent with 
the less than optimal methods we often use and the mod- 
est efforts of most students. 

What Do Tests and Grades Tell Us? 

Classroom tests often set the standard for students’ learn- 
ing. As with instruction, however, we tend to emphasize 
recall ol memorized factual information rather than intellec- 
tual challenge. Taken togetlier with our preference for lec- 
tures, our tests may be reinforcing our students’ commonly 
lact-oriented memory^ learning, of limited value to either 
them or society. 

Vmually all American colleges and universities employ 
grades as indicators of students’ — and the institution s — 
accomplishment. Student reter>tion, advancement, honors, 
and graduation, and therefore key public policy decisions, 
depend on these important symbols. ^c*t grades are often 
based on tests of uncertain technical quality and otlier, 
unknown components; they' individually carry little infor- 
mation and, combined into averages, correlate poorly w’iih 
success after graduation. Grades fuilher provide for many 
students a strong antidevelopmental inducement to the per- 
vasive cheating on campus studies consistently find. 
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How Does the Campus Climate Affect 
Our Students’ Development? 

The dimaic of a campus can welcome new students into 
what is for many an unfamiliar and threatening culture; 
provide the social interaction, emotional support, and per- 
sonal integration and validation needed for learning and 
retention on campus; and inspire each person to high 
effon. In many cases, however, research reveals little 
involvement beween students and the faculty, staff, or 
enher students, a climate of limited intellectual stimulation, 
and a climate that tolerates widespread cheating and alco- 
hol abuse, Studies frequently reveal campus environments 
where women and minority-group members are regularly 
devalued and overtly discriminated against. Together, this 
array of en\ ironmental conditions can powerfully militate 
against students’ success. 

How Well Do We Guide Our Students’ Development? 

Authorities wddeiy agree that academic advising is a power- 
ful tool for improving students' success, providing influen- 
tial opportunities for out-of-ciass contact between students 
and faculty and personalized guidance fo” negotiating a 
new and complex culture, achieving self-t, iderstanding, 
and planning one's own development. Today, high-quality 
adv ising focuses on each student's specific developmental 
needs. High-quality advising is correlated with increases in 
students’ self-esteem, satisfactiem with college, and persis- 
tence in school. Yet national surv^eys reveal that on most 
campuses academic advising, wiien it occurs at ail, tends to 
be |:)rimarily clerical in character rather than developmental, 
foc using as it does on registration. 

Can Today’s Students Learn? 

Given our students’ diverse backgrounds, frequent under- 
preparation, and limited academic success, with about half 
w ithdrawing before graduatic:)n, some faculty believe many 
lack the ability to learn. But striking success with elemen- 
tary' and high school students of modest academic origins 
and high-cjuality methods of instruction in college both 
demonstrate students’ potential for high achievement, pro- 
vided we adapt to their needs rather than demand they 
adapt to our traditions, nc higher the quality of iustruction. 
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the lower the correlation between students' assessed ability 
and the quality of their learning. 

How Can We Improve the Quality of 
The Student Outcomes We Produce? 

Research now available on the student experience in col- 
leges and universities shows we must make substantial 
changes if we are to serve society’s needs for highly edu- 
cated employees, citizens, and leaders. Significant steps we 
can take are to develop clear missions, carefully define our 
intended outcomes, hold high expectations for our students 
and ourselves, comprehensively assess both students and 
institutions, use research on student learning and organiza- 
tions, integrate our curricula, systematically design instruc- 
tion that will involve students actively at every' point, teach 
students how to learn, develop a campus climate that chal- 
lenges and supports each person, and ensure each student 
has high-quality developmental academic advising. 

Our widespread problems in enabling all our students to 
succeed require vigorous, systemic responses. Research on 
student development, coupled with modern educational 
methods and quality improvement {principles, can enable us 
for the first time in human history to educate all of the peo- 
ple to a high level. We w'ill, however, have to use, rather 
than ignore, research. Informed, committed, and sustained 
leadership at all levels w'ill be required, and institutions will 
have to invest in significant leadership training. Graduate 
schools will have to provide thorough, demanding profes- 
sional training as educators for the future faculty, and the 
current professoriat will require significant assistance in 
developing the diverse professional knowledge and skills 
now required to educate our students. Professionally pre- 
pared and accountable leadership and faculty' can develop 
a more positive and supportive culture on campus, build 
community and improve faculty and staff morale, and pro- 
duce the high-quality results society now urgently needs 
and is asking us to provide. 
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FOREWORD 



It was fully a generation ago that sociologist Martin Trow 
first alerted us to the imminent transition of American liiglier 
education from an elite system organized to educate but a 
fraction of the populace to one guided by the democratic 
ideals of universal access, the gateway to a learning society. 
And that transition in access would, 1‘row predicted, bring 
with it radical shifts in the social purposes of a college edu- 
cation (lifelong learning), academic standards (greater het- 
erogeneity), curriculum and instruction (flex time and 
place), faculty and administrative roles, and the politiciza- 
tion of the campus — or, more accurately, the dissolution of 
the boundaries between the campus and the polity. 

We have l^een living, and continue to live, that transition. 
With one hand, American higher education clings to the 
faculty- and discipline-centered model c^f academic work 
(Jencks s and Reisman’s academic revolution) that took 
shape after World War II and crystallized in the 1960s and 
I970s; with the other, it gropes toward a mcMc learner- 
centered model (^f collegiate education that can provide the 
broad human rescuirce platform needed to support the 
information society we are becoming. How' this dilemma 
resolves itself, and wliat role each c^f us can play in tliat 
resolution, is in the largest sense the question of the hour 
for American higher education. Mow will the transition be 
managed and how ve il! each of us — as faculty members or 
administrators — contribute to managing it? 

What resources do vve have at our individual and collec- 
tive disposal to address such pressing professional, and 
ultimately social and political, cjuestions? We have searching 
and scathing (u.sually more of the latter than the former) 
criticjiies of the faculty-centered mcxlel, including ProfScaw 
and Impostors in the Temple on the one hand and some 
visions of desirable learner-centered models on the other, 
among the most balanced of w'hich is the work of the 1984 
Nil! Study Group on the Conditions of Hxceiience in 
American Higher Education. 

Redcsignhig Higher Tdneation is distinctive in that it 
focuses neitlier cm critic jue nor on prescription alone, I'lut 
on the theoretically grounded links between the two. 

Within the context of contemporary theory* on student 
development. Lion Gardiner, associate professor of zoology 
at Rutgers University, examines the growing body of 
knowledge alxnit student learning, college outcomes, and 
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the effectiveness of various options for instruction and 
assessment as tlie basis for identifying an empirically 
grounded set of practices that we know lead to better 
learning for students. The challenge in moving to a more 
student-centered model is first clarifying what the basic 
elements of that model would be. And here Professor 
Gardiner scours the readily available and the more arcane 
sources, the widely published and the more and less scat- 
tered literatures, and melds them into a coherent and con- 
sistent portrait of how we might conduct our instructional 
mission, 

But faculty roles and instmctional strategies are, as Pro- 
fessor Gardiner recognizes, embedded in our organizational 
arrangements and cultures. And it is to the itiatter of effect- 
ing the organizaticmal changes that will support the re- 
design of college teaching that he devotes the latter pa it of 
the monograph. These changes include how we train our 
college teachers, how we develop our faculty and aca- 
demic administrators, and, ultimately, how we set our insti- 
tutional priorities. He concludes with an institutional agen- 
da for beginning to move forward. 

Professor Gardiner’s work w'as originally developed dur- 
ing his tenure as a Faculty Fellow at the New Jersey In- 
stitute for Collegiate Teaching and Learning, one of a grow’- 
ing number of state and regional initiatives to support and 
integrate the efforts of individual faculty who continue to 
stmggle betw'cen the norms of their socialization and the 
needs of their students. This volume will, I hope, ser\'e :is a 
resource for that journey. 

Martin J. FinJkelsteiii 

Director, New' Jersey Institute for 
Collegiate Teaching and Learning 

Seton Mall Hniversity 




New Jerst*y Institute 
for Colle^ate 
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INTRODUCTION 



The world is far smaller today than it was at the end of 
World War II. Transpoitaiion and communication link us 
firmly with other nations. Trade and finance are global. The 
last decade witnessed an extraordinary movement toward 
democracy, and many other nations now seek, through 
education and technology, benefits for their people we 
have long enjoyed. Some of these nations now press us 
economically and even threaten to outpace us. Leaders in 
business and government have warned for some time that 
we may have become complacent. 

Technology is changing society. The U.S. Department of 
Labor projects a 22 percent increase between 1988 and 
2000 in jobs requiring education beyond high school 
(“Demand” 1990). By 2000, a majority of ^//new jobs in 
the United States will require education beyond high 
school (National Task Force 1990). We in higher education 
have been asked to respond vigorously to prepare our stu- 
dents for this technological environment, an environment 
very' different from the one many of us faced at graduation. 

White males, the historic mainstays of technological pro- 
fessions, today account for an increasingly smaller part of 
the workforce. From 1985 through 2000, they will number 
a mere 15 percent of new workers (Pool 1990). Women, 
members of racial and ethnic minority groups, and foreigners 
will have to make up the difference. Many more mathe- 
matics and science teachers — teachers in those disciplines 
that will b^ essential to our technological advance — could 
be needed over the decade ahead (Darling-Hammond and 
Hudson 1990). 

Educating All the People 

During the three decades following World War II, U.S. col- 
lege and university populations expanded far more than at 
any previous time. Between 1947 and 1963, enrollments 
increased more than twofold, by 1977 an additional fivefold 
(Pew 1990). The wave of servicepeople returning from the 
war was later followed by another — their children, the baby 
boomers of the 1960s. 

The late 1960s and 1970s brought with them another 
development that profoundly affected institutions of higher 
education. Efforts to increase social equity, particularly by 
state governments, led to large numbers of so-called “new” 
students, who began to appear on campuses across the 



Redesigning Higher Education 



country' (Cross 1971). Women, people of color, and part- 
time and older students all made their presence felt in insti- 
tutions long ovei*vvheImingIy the preser\'e of while, male, 
“academically adept adolescents” (Pew 1990, p. 1). By 

1984. 19.7 percent of college students were non white; b) 

1985. 42 percent were older than 25, 52 percent were 
women, and 42 percent attended part time (Smith 1989). 
Today, these new students have swollen student popula- 
tions until, together, they number over 14 million people 
(Naiional Center 1993). Moreowr, whereas previous gener- 
ations of students overwhelmingly lived on campus, today 
80 percent of undergraduates in this country commute to 
college (Jacoby 1989). 

The new students, far more representative of Americans 
as a whole than their predecessors, were also less well 
educated and thus less w'ell prepared for college than their 
relatively more privileged peers. Therefore, they brought 
with them to college challenges quite different from those 
their institutions had previously confronted. In many cases, 
these students came from families less economically well 
off. The goals to which they aspired, their styles of learn- 
ing, and their needs were all significantly different from 
those of more traditional students. 

These ehanges in our students have continued apace. 
I'raditional, first-time, full-time, undergraduate students who 
enroll in college directly from high school will soon be out- 
numbered by a new' “emerging majority”: students who are 
part time, 25 years of age or older, and who have not 
come to college directly from high school or who have 
stopped out of college for longer than a year (Pew 1990). 
in I960, students of Caucasian ancestry made up 90 per- 
cent of undergraduates at the University of California- 
Berkeley; in 1980, they accounted for 66 percent and, more 
recently, about 45 percent (Duster 1991). In 1991, entering 
first-year students at Berkeley were for the first time pri- 
marily people of color. Asian-Americans alone constituted 
35 percent of the class, whites a mere 30 percent. This 
trend will continue. In 1988, 20 percent of children under 
age 17 were members of racial minorities; by 2000, they 
will make up one-third (Commission on Minority 1988). 

Today, we are being asked to educate all of the people 
to a very high level. Society depends on us to develop 
people who can, as employees, meet the needs of business 
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for the international competition of the 21st centuiy. In 
addition, our graduates will be central to solving every' 
major social problem that faces us — ineffective schools, 
unstable families, dmg abuse, crime, international conflict, 
environmental degradation. We are witnessing a prolifera- 
tion of partisan strife worldwide and an explosion of intc>I- 
erant ideological division at home. Society depends on us 
to produce graduates who have a sophisticated understand- 
ing of themselves and others who differ from them, who 
have the values and intellectual, professional, and social 
skills required as teachers, social workers, criminologists, 
ecologists, businesspeople, and citizens to lead our democ- 
racy into the new century' and to create a peaceable and 
economically productive national and world community. 

Many observers believe higher education has entered a 
period of change as great as any it has ever experienced. 
Although our system of higher education may be the best 
to have been developed by any nation, many question 
whether we continue to meet society's needs. They believe 
we will have to alter fundamentally many of the ways we 
conduct our affairs if we are to produce the quality of 
graduates society now requires. Although students of the 
last quarter century have in many ways been very different 
from their predecessors and although society has much 
higher expectations for their educators than /er before, 
many of our constituents believe we in higher education 
have not responded well to our students' needs and have 
fallen far short of society's expectations. In 1983, A Nation 
at Risk: ne Imperative of Educational Reform (National 
Commission 1983) called attention to widespread educa- 
tional problems in this country. Since then, a series of 
highly critical reports have focused specifically on quality 
in higher education, expressing a growing sense of urgency 
about perceived inadequacies and necessaiy changes 
(Bennett 1984; Boyer 1987; Cheney 1990; Commission for 
Educational 1994; Project on Redefining 1985; Study Group 
1984; Wingspread Group 1993; Working Party 1986). 

Purpose and Scope of This Report 

How valid are these public perceptions? How effective are 
we at educating our students? Unfortunately, because few' 
colleges or universities assess in detail what their students 
know and are able to do, either when they arrive on cam- 
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pus or when they graduate, they have limited information 
on which to base answers to these questions. Further, no 
comprehensive state or national assessment provides this 
evidence. The professional research literature on higher 
education, however, now contains much valuable informa- 
tion, albeit widely scattered, that can 1 jlp us answer these 
questions and provide essential guidance to learn how 
effective we are and to improve the quality of our stu- 
dents’ learning. 

This monograph brings together in one place the findings 
of hundreds of studies on various aspects of higher educa- 
tion and attempts to make them readily available. Its pur- 
poses are to help readers better understand their institu- 
tions by providing a basis for continuously improving the 
quality of their students’ learning and to stimulate informed 
discussion about students and learning everywhere. The 
primary focus is the status of four core areas central to the 
quality of student development (used throughout this 
monograph to refer broadly to any desirable and natural 
change in students’ cognitive, affective, or motor capacities) 
in higher education: curriculum, instruction, campus psy- 
chological climate, and academic advising. It reviews em- 
pirical research that illuminates the impact of each core 
area on students’ learning and accomplishment of missions 
and that can (1) guide readers’ thinking as they reflect on 
the current quality of their own courses, programs, institu- 
tions, and systems; (2) help them discover fresh insights 
and new ways of viewing their work and organizations; 
and (3) enable them to identify areas where they can im- 
prove quality on campus. The report also provides numcT- 
ous specific suggestions on how to improve the contribu- 
tion of each core area to students’ development and sug- 
gestions concerning issues of leadership and management. 

The report is addressed to the following audiences: 

• Faculty members who, although well trained in the 
content of their disciplines, may be less familiar with 
the professional literature on student development or 
educational processes and wish to enhance their own 
professional knowledge and skills, thereby helping 
their students learn more effectively; 

• Trustees and academic administrators — presidents, 
provosts, deans, department chairs — responsible for 



4 




19 




accomplishment of missions, who might gai i deeper 
insight into what does, does not, and should go on 
inside — and outside — the classroom and into methods 
of leadership that can more effectively meet the educa- 
tional needs of all their constituents; 

• People responsible for faculty, instructional, and lead- 
ership development, who might identify specific areas 
on w'hich to focus their efforts and key issues to raise, 
and find empirical support for various practices and a 
rich collection of w'ritten resources to help in solving 
problems; 

• Student affairs professionals, w'ho can gain insight into 
their students experiences, paiticularly in their aca- 
demic activities, thereby more effectively helping them 
to integrate their education (see Bloland, Stamatakos, 
and Rogers 1994 for a critique of student development 
efforts in student affairs); 

Government leaders — elected officials, members of 
their staffs, and members or higher education coordi- 
nating agencies — charged with guiding public higher 
education, ensuring taxpayers a high return on their 
investment, and overseeing an enterprise central to the 
future well-being and economic success of the states 
and the nation; 

• Journalists who interpret higher education to their com- 
munities, who can find up-to-date information on 
important research, issues, and social concerns affecting 
colleges and universities and can discover ideas and a 
wide array of resources to aid them in their w'ork; and 

• Concerned citizens — business leaders, taxpayers, par- 
ents, and students — who are our customers and pay our 
way, who can gain insight into human development and 
an overv'iew of the higher education enterprise, which 
will have an increasingly powerful impact on society. 

in every' case, readers can use the report as a resource to 
inform decision making and action. 

l‘he section following this introduction reviews the most 
important abilities society requires of students today, the 
results of research describing how certain of these caicial 
abilities develop, and tiie conditions that are now believed 
necessary to produce them. The follcAving four sections 
examine the four core areas central to student development 
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and the contribution researcli suggests they now make to 
this development: curriculum; instruction (methods, the 
intellectual climate of the classroom, students' involvement, 
classroom tests, and grades); the campus climate; and aca- 
demic advising. 

The final four sections lay out the challenge to higher 
education and describe rich opportunities for producing 
dramatic gains in students’ learning, examining evidence 
about the relative capacity of students to learn at a veiy 
high level; describing seven specific changes we can make, 
each one of which can improve students' learning and 
together can lead to significant gains in an institution’s 
overall capacity to produce learning; and addressing over- 
arching issues ot leadership, management, and professional 
developinent necessary to foster the essential changes and 
link everything together in a systemic whole. The final sec- 
tion presents a vision and a challenge to develop a new 
kind of community nn campus. 
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WHAT IS STLOENT DEVELOPMENT AND 
HOW DOES rr happen? 



What Are the Critical Competencies? 

Leaders in business, industiy, and government have identi- 
fied certain knowledge, skills, and dispositions as especially 
important for personal, business, and national economic 
and democratic success in the years ahead: 

• Conscientiousness, personal responsibility, and 
dependabiliry 

• The ability to act in a principled, ethical fashion 

• Skill in oral and written communication 

• Interpersonal and team skills 

• Skill in critical thinking and in solving complex 
problems 

• Respect for people different from oneself 

• The ability to adapt to change and 

• The ability and desire for lifedong learning (Candy 
and Crebert 1991; Carnevale, Gainer, and Mcltzer 
1990; ’‘Challenge" 1995; Marshall 1989; Van Horn 1995; 
Wingspread Group l‘^^93)- 

The amount of information being created today is enor- 
mous compared to any time in our history'. Over a decade 
ago, an estimated 6,000 to 7,000 papers in science alone 
were being written daily, and information in science and 
technology was doubling every 5.5 years, a rate of increa.se 
that was projected to ‘jump to perhaps 40 percent per 
year" (Naisbitt 1982, p. 24) because of computer manipula- 
tion. As a result of this high rate of discover)^ knowledge 
today becomes relatively quickly obsolete, and "in this era 
of the knowledge explosion, what students know when 
they leave college will not be nearly as important as what 
they are capable of learning" (Cross 1986, p. 10). Learning 
must continue throughout life. 

How closely do the outcomes we in the academy desire 
for our students compare w4th the abilities required today in 
the world of work? Faculty agree almost universally that the 
development of students' higher-order intellectual or cogni- 
tive abilities is the most important educational task of col- 
leges and universities. These abilities underpin our students 
perceptions of the world and the consequent decisions they 
make. Specifically, critical thinking— the capacity to evaluate 
skillfully and fairly the quality of evidence and detect error, 
hypocri.sy, manipulation, dis.sembling, and bias — is central to 
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lx)th personal success and national needs. A 1972 study of 
40,000 faculty members by the American Council on Edu- 
cation found that 97 percent of the respondents indicated 
the most important goal of undergraduate education is to 
foster students’ ability to tnink critically (Milton 1982). We 
also value highly creative problem solving and invention. In 
a 1989 surv'ey of 5,450 faculty members from all r/pes of 
institutions by the Car-negie Foundation for the Advance- 
ment of Teaching, 70 percent of the respondents staled 
that enhancing creative thinking in undergraduate educa- 
tion is very' important (Boyer 1989), Bowen’s Catalog of 
Goals, based on his review of 1,500 goal statements he 
found in the literature of higher education, includes such 
widely accepted cognitive outcomes as skill in written and 
oral communication, ^juantitalive skills involving (among 
others) elementary' mathematics and statistical reasoning, 
and rationality — Ic^gical, objective thinking, a “disposition to 
weigh evidence, evaluate facts and ideas critically, and . . . 
think independently,” and a developed "ability to analyze 
and synthesize” (Bowen 1977, p. 55). Also important are the 
tolerance of or openness to novel ideas, a “willingness to 
question orthodoxy,” the capacity “to deal with complexity 
and ambiguity,” and “appreciation of intellectual and cu- 
ltural diversity” (p. 55). 

College and university faculty by no means limit the out- 
comes they value to the cognitive domain. Primarily affec- 
tive outcomes include an appreciation of esthetic expres- 
sion in literature, an, and nature; intellectual integrity; and 
a desire for lifelong learning (Bowen 1977). Explicitly emo- 
tional and moral concerns include .sensitivity to feelings and 
emotions, emotional stability, a.ssertiveness, self-confidence, 
acceptance of .self and others, the capacity for empathy 
(putting one.self in the place of another), respect and toler- 
ance for and cooperation with diverse people, a demo- 
cratic, nonauthoritarian point of view, the belief in inter- 
nalized and nor dogmatic moral principles, and a sense of 
social responsibility (Bowen 1977). 

Faculty also usually desire their graduates to have suh- 
•stantive knowledge about both western and nonwestern 
traditions, philosophy, natural and social science, and litera- 
ture and art, as well as knctwledge, skills, and values 
appropriate to some area of concentration. "Education of 
the whole person" is a goal many of us hold dear. 
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Clearly, the faculties of U.S. colleges and universities 
and leaders in various sectors of society agree substantially 
on the desired outcomes of student development. Acquir- 
ing the kinds of knowledge, skills, and values we our- 
selves respect should well equip our graduates for the 
realities they will face as citizens and workers, and for 
meeting the nation’s increasingly urgent need for a highly 
educated citizenry. 

How Do the Critical Competencies Develop? 

Research conducted during the last three decades has illu- 
minated key dimensions of our students’ development cen- 
tral to producing these important abilities, enriching our 
understanding of what schools and colleges can do for 
their students. For example, many laypeople conceive oi 
intelligence, the ability to learn and engage in cognitively 
complex behavior and abstract problem solving, as being 
primarily determined by unchangeable genetic characteris- 
tics. Although it is influencedhy heredity, however, many 
cognitive psychologists understand intelligence more flexi- 
bly in terms of dynamic Intellectual processes that can be 
developed and significantly improved (Baron 1985; Binel 
1909 , cited in Covington 1985; Ceci 1990; Cronbach 1984; 
Gardner 1985; Linn 1989; Plomin 1990; Schaie and Parr 
1981; Sternberg 1985, 1986). "Intelligence is achievement-— 
the result of past learning as well as a predictor of future 
learning” (McKeachie et al. 1990, p. 5). ‘intelligence is edu- 
cation’s most important product, as well as its most impor- 
tant raw material" (Snow 1980, p. 185). 

This new knowledge about student development has 
become essential if colleges are to understand their diverse 
student clients and design educational experiences that can 
meet their needs (Chick^ring and Associates 1981; Del- 
worth, Hanson, and Associates 1989; Fried 1981; Hood and 
Arceneaux 1990; Knefelkamp, Widick, and Parker 1978; 
Parker 1978; Pascarella and Terenzini 1991; Rodgers 1989; 
Uperaft, Gardner, and Associates 1989). To develop an 
essential conceptual foundation for discussion throughout 
this report, this subsection briefly reviews four key aspects 
of student development: the capacity for abstraa reasoning, 
epistemology, the capacity for principled ethical reasoning, 
and the ability to work cooperatively in groups. Together 
with other dimensions of development, these four aspects 
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make key contributions to that educational outcome with- 
out price — wisdom (Sternberg 1990). 

Capacity for abstract reasoning: A foundation 
of higher-order abilities 

All types of complex, higher-order reasoning, such as criti- 
cal thinking, the creative solution of problems, and princi- 
pled ethical reasoning, require as their prerequisite the 
capacity to manipulate abstractions — value, change, good 
and bad, purpose, trust, responsibility, democracy — not to 
mention myriad technical concepts like balance of pay- 
ments, organic evolution, social class, and force, constan ts 
that permit us to comprehend the world, contribute to its 
well-being, and enjoy it fully. In other words, we must be 
able to think with abstract symbols that stand for complex 
meanings and be able to manipulate these symbols, singly 
and with others, to constaict new meaning for ourselves. 
Hvery discipline and professional field represented in the 
curricula of colleges and universities presupposes students’ 
capacity to manipulate its abstractions. 

Piaget discovered that not until about age 1 1 are children 
lirst able to reason with abstractions, a process known as 
"formal reasoning" (Inhelder and Piaget 1958; Piaget 1972). 
The reasoning or cognitive operations of younger children 
are thought to be limited to a concrete world of real ob- 
jects, people, and situations. Later studies of college stu- 
dents, however, have repeatedly demonstrated in various 
Melds that, despite their age and regardless of our own per- 
ceptions of their reasoning ability, a majority of our stu- 
dents are still concrete operational or transitional thinkers, 
somewhere between concrete and formal in their reasoning 
abilities (Dunlop and Fazio 1976; Hardy-Brown 1981; 
Kolodiy 1975; Kuhn et al. 1977; McKinnon and Renner 
1971; Robbins 1981; Tomlinson-Keasey 1978). For example, 
a study ot first-year physical science students at Rutgers 
University and Essex County College, all but a few of 
whom stated an interest in science-related majors, found 
that at least two-thirds of the students had not yet becoi;ie 
formal thinkers (Griffiths 1973). Among 53 Rutgers students, 
of whom 3-8 percent were members of minority groups, 
only iA percent were fully formal operational thinkers; f)6 
percent were not yet formal. Of 59 Essex students, who 
included among them 57.9 percent minority group mem- 



bers, 27 percent were categorized formal operational and 
73 percent were nonformal. Studies further suggest that, 
without specific assistance from teachers, students may 
remain thus cognitively limited throughout their lives. 

The study also discovered that m ny of the nonformal stu- 
dents, 55 percent at the university' and 23 percent at the com- 
munity college, depended (many of them presumably suc- 
cessfully) on the memory' and recitation of technical jargon, 
such as mass, force, and momentum. These nonformal opera- 
tional students did not understand the concepts represented 
by the terms they used. The rest of the nonfomial students, 

1 1 percent and 50 percent at the two institutions, respec- 
tively, lacked even technical teniis to use and were helpless 
(see also “The problem of misconceptions” on p. 47 and "De- 
velopment of higher-order cognitive abilities” on p. 50). 

Concrete operational students “will consistently be unable 
to follow many lines of argument” in lectures; students in 
transition to formal operational reasoning “will frequently 
encounter difficulties” (Robbins 1981, p. 209). Only fully 
formal students “will in general have no difficulty following 
the abstract reasoning found in the average . . . lecture" (p. 
209^ Nonfomial thinkers will have difficulty imagining pos- 
sibili es that could exist now, in the past, or in the future; 
engaging in propositional, probabilistic, and correlational 
reasoning; considering relevant variables separate from 
each other; and conducting mental operations, such as in 
mental experiments. Such students may be unable to en- 
gage in metacognilion — the critical examination of their 
own thinking for inconsistencies and for appropriateness of 
explanation — and the ability to compare and contrast differ- 
ent approaches to solving problems (Karplus et al. 1977). 
Their limits in thinking hypothetically and deductively com- 
promise their understanding of many essential components 
of college- level reasoning; experiments in science — not to 
menMon much that is central to mature understanding in 
other fields — may be beyond their ken. 

These studies raise serious questions about what nonfor- 
mal students, who in many institutions constitute a major- 
ity’, might be learning in their courses and about what 
kinds of knowledge and skills tests assess. Studies show 
striking correlations between students* capacity for formal 
operations and success in college courses (Hardy-Hrown 
1981; Iludak and Anderson 1990). 
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Research generally shows inconsistent patterns in the 
development of formal reasoning skills, or relatively small 
increases, over the college years (Pascarella and Terenzini 
1991). Specially designed instruction, however, such as the 
ADAPT Program at the University of Nebraska-Lincoln 
(ADAPT 1978) and Project SOAR at Xavier University of 
Louisiana (Carmichael et al. 1978), have long been more 
successful than conventional instruction in fostering effec- 
tive movement from concrete to formal reasoning. Such 
programs emphasize students’ active involvement in learn- 
ing and cooperative work with other students and deem 
phasize lectures, which consistently benefit only the most 
formal of students (Kolodiy 1975). 

Epistemology: Precondition for critical thinking 

A second dimension of cognitive development that is of 
great practical impoitance to college teachers is a student s 
epistemology: the assumptions he or she makes about the 
origin of knowledge and value and about the role of 
authority in learning and life. 

A study of several cohorts of Harvard undergraduates 
(Perry 1970, 1981) identified nine distinct epistemologies or 
"positions” a student passes through during development 
and, therefore, different sets of beliefs he or she sequen- 
tially holds about content, activities, and roles central to the 
process of learning in college. Numerous other researchers 
have confirmed and expanded these findings (Baxter- 
Magolda 1990a, 1990b, 1992a, 1992b; Baxter-Magolda and 
Porterfield 1985; Belenky et al. 1986; King and Kitchener 
1994; Moore 1989, 1991a). These nine positions are summa- 
rized here as four different, sequential le\els. 

A student currently at the first level. Dualism, under- 
stands the world in dualities: black-white, right-wrong, 
good-bad, "my group and its beliefs are good, other 
groups and their beliefs are bad.” All questions, issues, or 
problems have one right answer or solution; all alterna- 
tives are wrong. One learns what is correct and what is 
the right thing to do from Authorities, because Authorities 
Know, '’.he Dualist thus depends on authorities and tends 
to be docile, accepting, and therefore manipulable; "critical 
thinking’’ is an inscrutability. Self-critical metacognition, the 
capacity to examine and critique one s own thoughts, 
beliefs, and values, is impossible. Dualism constitutes a 
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potential wellspring of etlinocentrism, fanaticism, and 
self-centered, intolerant ideology of every stripe. Siibniis- 
siveness to established authorities and self-righteous feel- 
ings of superiority over people and groups dissenting 
from one’s own viewpoints characterize dualistic authori- 
tarianism, which can pose great danger to society (Alte- 
meyer 1988), 

The second epistemological level is Multiplicity, The 
Miiltiplist has come to understand that there can be more 
than one legitimate way to look at a situation, that compe- 
tent authorities can disagree, But the Multiplist is trapped in 
subjectivity; in the absence of an agreed-upon Taith. one 
opinion is as good as another. To have an opinion makes 
the opinion right: “You have your opinion and I have mine, 
and that’s cool.” This shallow ‘•tolerance" of dissent, how- 
ever. is quite distinct from the thought-through and respect- 
ful acceptance of diversity we desire for our students and 
that society urgently needs. The Multiplist’s key cognitive 
deficiency is not to comprehend the complex, contextual 
interrelationship of factors and the need to identify these 
factors carefully and evaluate critically the relative quality 
of evidence available in support of alternative opinions, 
ideas, or hypotheses. 

Under appropriate conditions, Multiplists can move grad- 
ually into the third epistemological level, Relatirism, whose 
meaning here is quite different from the conunon lay use 
of the term, which is more akin to the subjectivity found in 
Multiplicity. A Relativist understands tlie complex, contex- 
tual, interrelated nature of the world, and his or her gradu- 
ally developing critical capacity is deliberately applied to 
evaluating the quality of evidence adduced in support c)f 
claims. Complex relativistic procedures underpin the think- 
ing of all well-educated men and women and experts in 
cver>' field, presupposing the developed capacity for for- 
mal, abstract reasoning, Metacognitive ability and empathy 
with others first appear at this time. 

Finally, having entered the fourth level, Comniitnient, 
understood today as part of identity formation rather than 
epistemology per se, a student comes to realize that, despite 
living in a complex, contingent world, he or she tnust 
nevertheless coAW/n r 7 personal values and principles tor 
living and make personal commitments to people, causes, 
and career. 
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Clearly, a student’s current epistemological level is a key 
factor affecting his or her response to efforts to induce 
learning, Dualists may eagerly take notes in traditional lec- 
tures but reject appeals for the critical thinking caicial to 
their development. They may resist cooperative group work 
with other students, whom they view as lacking credibiliry 
as authorities in the field, Both Dualists and Multiplists may 
be unable to understand the point of carefully collecting 
and evaluating evidence or of experimental thinking, the 
basis of much that w'e teach. Relativists may not yet see a 
personal need for the commitments that provide a founda- 
tion for adult behavior. 

Studies consistently show' that most of our undergradu- 
ates hold Dualistic and Multiplistic epistemologies at the 
lower end of the scheme. Most first -year students of tradi- 
tional age are authoritarians (Sanford 1962); Relativists arc- 
rare. Sixty-eight percent of 101 Miami University (Ohio) 
tirst-year students in one study were Dualists (Baxter- 
Magolda 1992a), Although many or most students increase 
in epistemological complexity during college, the move- 
ment is slow and uneven. In studies of mostly college 
undergraduates in diverse institutions, the percentage of 
students moving one-third or more ’’Perry Position” (part of 
a “level” as used here) during one semester ranged from 27 
to 56 (W, Moore 1991a), Another study show'ed an overall 
change from first year to graduation of less than one-half 
Perry Position (Mentkowski and Strait 19B3). In fact, studies 
suggest most undergraduate students never reach Relativism. 
The percentages of undergraduate students testing as 
Relativists (Periy' Position 5) in two samples were only 0.04 
(N = 2,757) and 0,26 (N = 391) (calculated from data of 
William S. Moore, cited in MacGregor 19^7), Relativists 
made up 2 percent of the Miami (Ohio) senior-year sam- 
ples (N = 80); in the year following graduation, this num- 
ber had increased to 12 percent (N = 70) (Baxter-Magokla 
1992a), A sample of 26-4 Rutgers University students found 
no Relativists.* 

The implications of these studies are important for the 
way we attempt to educate students and assess out come. < 
(King 1978; Knefelkamp and Slepitza 1978), For example. 
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wliy is students’ epistemological development in college so 
slow? If most students do not understand the need for criti- 
cal evaluation of evidence, how much do they understand 
Cor what are they being asked to do) in their natural and 
social science courses, for example, and why are most of 
them not failing their tests in these courses? (See “What Do 
Classroom Tests Measure?” on p, 60.) If most graduate not 
yetjielativists, how well prepared are they to understand 
and deal skillfully with the competing points of view they 
will confront on iiiipoitant issues in all areas of their lives 
and professions? How many of our graduates can we claim 
are critical thinkers? 

The percentage of incoming Canadian students who 
scored ‘at least ‘slightly authoritarian’” increased markedly 
from 1973 to 1987, from 54 percent to 80 percent (Alte- 
meyer 1988, p, 327), including the upper three of six cate- 
gories. Altemeyer’s work also, howe\ er, demonstrates a 
positive effect of college attendance on reducing authoritar- 
ianism. In a society and world increasingly racked by vio- 
lent division among people based on differences of race, 
nationality, and religion, developing our students’ episte- 
mologies — their understanding of complexity' and interre- 
latedness and their careful use of evidence — is surely one 
of our most important responsibilities and challenges. 

Capacity for principled ethical reasoning: 

The basis for moral behavior 

Higher education in this country has been involved in 
developing character and values since its inception in 1636 
with the founding of Har\^ard College. Leaders in govern- 
ment, business, religion, and higher education, how'ever, 
have for some time been urging us to redouble our efforts 
to ensure graduates have developed the capacity for ethical 
behavior. Many share this concern for moral education; 85 
percent of respondents to the 1989 Carnegie faculty sur\ey 
believed it was "very important” (41 percent) or "fairly 
important” (44 percent) to "shape student values in under- 
graduate education" (Hoyer 1989). Many colleges and uni- 
versities, although by no means all, have their students* 
moral development as a stated educational outcome. In 
one study, 31.6 percent of all 19 New Jersey community 
colleges had as a general education goal for their students 
to ‘‘demonstrate the ability to make informed judgments 
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concerning ethical issues” (College Outcomes Evaluation 
Program 1990a, p. 47). On the other hand, only one in 1.^, 
or 8.3 percent, of public four-year institutions in New 
Jersey reported having such an intended outcome. 

Moral development can be partitioned into four separate 
but related components: (1) rrioral or ethical sensitivity — 
recognizing a situation contains moral issues; (2) moral 
judgment — determining right action; (3) moral motivation — 
caring to do the moral thing; and (4) moral character — 
behaving in a moral way (Rest 1984, 1986, 1994a). The h>ur 
components are by no means equal in their level of de\ el- 
opment in any person, but inadequate develof^ment in any 
one of the components can result in moral failure. The 
components can be assessed separately from each other, 
and they require different experiences for their develop- 
ment (Bebeau 1994). 

Complexity of moral judgment is linked to moral behav- 
ior (Bredemeier and Shields 1994; Duckett and Ryden 1994; 
Ponemon and Gabhart 1994; Rest 1994b; Thoma 1994), and 
research reveals common patterns in our reasoning about 
issues with moral content (Colby and Kohlberg 1987; Gil- 
ligan 1977, 1981, 1982; Kohlberg 1981; Kohlberg, Boyd, and 
Levine 1990; Kohlberg, Levine, and Hewer 1983; Nucci and 
Pascarella 1987; Rest 1979, 1986; Rest and Narv'aez 1994; 
Rich and DeVitis 1985). Knowledge of these patterns is 
essential for those who attempt to foster students’ moral 
development. One’s current reasoning about moral issues, 
situations, or problems depends upon the distance he or 
she has progressed through a series of discrete, sequential 
developmental stages, each representing a distinct moral 
philosophy. Researchers have investigated moral judgment 
in many diverse populations, among them urban and airal 
Americans, meml^ers of upper and low'er social classes, 
adherents to various religions (Rest 1986. 1994a), and peo- 
i:)le of many different cultures (Snarey 1985). To the extent 
to which this conceptual framework remains consistent for 
such disparate populations, it ccmld represent a tmly objec- 
tive, universal pattern of moral decision making. Knowing 
our own students' developmental levels provides a means 
of understanding them and their reasoning about issues 
with moral content, and it can enable us to develop educa- 
tional methods cffectix'e for helping them continue their 
development. 
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At Stage 1 moral judgment, one’s orientation is to punish- 
ment and obedience. What is right action is behavior that 
will avoid punishment and trouble from powers superior to 
one’s own. Stage 2 moral judgment views right action as 
serving one’s own desires and needs, and sometimes oth- 
ers’. A person adapts to his or her perceptions of what oth- 
ers want; “You scratch my back and I’ll scratch yours.” 
Mutual advantage of this sort defines reciprocity, not prin- 
ciples of justice, loyalty, gratitude, or responsibility. 

Stage 3 reasoning is sometimes referred to as a “good 
boy-nice girl” orientation. What is right is what will gain 
one favor or approval in the eyes of important others. 
Students at Stage 3 often support stereotypes of majority 
or “natural” behavior. 

Stage 4 judgment supports a law-and-order perspective. A 
relatively rigid respect for authority and duty, abiding by 
fixed rules, and maintaining the social order are primary 
concerns for Stage 4 students. At Stage 5, however, students 
understand the relativity of values in the epistemological 
sense described earlier. As in Stage 4, the law is important, 
but morality is here understood more flexibly as based on 
social consensus; law's are capable of change in response 
to social need. The official moral philosophy of the United 
States as expressed in its Constitution resides at Stage 5. 

The “autonomous” morality of Stage 6 is based on univer- 
sal ethical principles. People reasoning at this stage consider 
what is right a matter of individual conscience as defined by 
self-chosen, abstract, and universal ethical principles or val- 
ues, as distinct from rigid, concrete. Stage 4 laws — the 
Golden Rule rather than the Ten Commandments. These 
principles articulate justice, reciprocity, equality, and respon- 
sibility among people. Respect for all persons as human 
beings, regardless of race, ethnic grou^‘, or creed, is impor- 
tant to students at this stage. Stage 6 requires the hypotheti- 
cal reasoning characteristic of abstract, formal operations 
and a Level 3 relativistic epistemology. Gilligan suggests that 
women tend to emphasize quality of interpersonal relation- 
ships and care-giving responsibilities in considering moral 
issues (Gilligan 1977, 1982), although most studies do not 
show gender differences (Thoma 1994). Stages 1 and 2 are 
Preconventional, Stages 3 and 4 (the modal stages of moral 
reasoning of most people) Conventional, and Stages 5 and 6 
Postconventional . 
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As one moves through the stages toward more complex, 
abstract postconventional or principled moral reasoning, 
thinking is increasingly less selfislily oriented and more 
able to recognize the rights and needs of others. Most 
undergraduate college students reason primarily at conven- 
tional Stages 3 and 4. Thus, they often learn principled 
solutions to ethical problems 'largely by rote,” “have trou- 
ble extending principles beyond the cases specifically 
taught,” “are baffled when ideals conflict,” and “oversim- 
plify life situations” (Rest 1994b, p. 214). Thinking about 
moral issues generally increases in complexity and percent- 
age of postconventional principled reasoning through the 
college years, albeit often relatively slowly (Mentkowski 
and Strait 1983; Pascarella and Terenzini 1991). Specific 
educational interv'entions in college can increase the moJal 
stage of moral reasoning (Bebeau 1994; Duckett and Ryden 
1994; McNeel 1994; Rest 1986, 1994b; Self, Olivarez, and 
Baldwin 1994; Sprinthall 1994; Whiteley 1982; Whiteley and 
Yokota 1988). Ensuring all our students have ample oppor- 
tunity to consider relevant moral dilemmas in many differ- 
ent courses, and thus develop their capacity for reasoning 
about the worth and ethical treatment of others, is crucial 
to fitting them for effective citizenship and leadersliip in 
the state, nation, and world. 

Implications for students* development 

The ability of our students to increase in these throe types 
of cognitive and ethical de\'elopmont during their college 
years holds great significance for our diverse, multicultuial 
society. The increased cognitive complexity that attends this 
development, and thus the capacity for self-knowledge and 
self-control, brings with it the potential for significant im- 
provement in mutual understanding and respect among dis- 
parate groups and the creative solution of our pressing 
social problems, not to mention superior technological, 
economic, and artistic productivity. Planned and systematic 
development of these complex abilities is now essential if 
our society is to continue to flourish. 

How are these abstract cognitive and ethical capacities 
developed? The cognitive complexity necessary' for ad- 
\’anced formal operations or problem-solving ability ‘‘is de- 
veloped . . . through hard, disciplined work in self-critical 
pursuit of high standards” (Lerner 1989, p. 174). The several 
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major cognitive reorganizations that underpin mature, rela- 
tivistic epistemology and the capacity to engage in princi- 
pled ethical reasoning are difficult transformations to make. 
Authorities agree movement through these interconnected 
developmental sequences entails the gradual and repeated 
reconstruction of the way a student views the world. 

The development of cognitive complexity happens slowly, 
involves potential emotional obstnactions, and is thought to 
require extensive practice in reasoning, together with regu- 
lar assessment, prompt feedback, and reflection. For exam- 
ple, students who use primarily Stage 3 conventional moral 
reasoning cannot underst.'.nd and therefore respond to or 
profit from illustrations, examples, or problems that require 
postconventional, principled ethical reasoning. If these stu- 
dents are to benefit from our instmetion, research suggests 
they must be approached only slightly above their current 
level. Further, scant evidence exists that this increase in 
cognitive complexity can be developed passively through 
lectures, automatically through the steady acquisition of 
facts and concepts, or through learning “steps” in “how to 
think.” “There is little doubt that higher levels of cognitive 
and moral reasoning cannot be directly taught” (Johnson 
and Johnson 1989, p 49). 

The evidence that people cannot understand epistemolo- 
gies or moral reasoning more than one level or stage 
beyond their own — the concept of "plus one” — suggests 
our instruction needs to be carefully designed so that, 
wherever he or she is developmentally situated, a student 
can engage in personally meaningful activities in a broad 
diversity of disciplinary, moral, emotional, and social con- 
texts that can ease movement toward the next higher level 
of complexity. We need to know at what point students are 
in their development if we are to .'’chieve the educational 
effects we want. We also need the essential body of profes- 
sional knowledge and array of skills that can enable us to 
accomplish this difficult developmental task, the central 
core of the teaching profession. 

Ability for cooperative work: The basis for community 

Developed interpersonal skills and the ability to work 
effectively in teams with others have become high priorities 
for employers. What does research tell us about the value 
of cooperation? To w'hat extent should we emphasize coop- 
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eration as compared to primarily individual work or com- 
petition? (Kohn 1992; Rich and DeVitis 1992). A meta-analysis 
of 521 studies comparing the relative effects of cooperative, 
competitive, and individualistic behavior on many different 
outcomes, 40 percent of which were conducted in college 
and university settings, found individual efforts consistenrly 
outperformed competitive efforts where the two approach- 
es were compared Ooi^nson and Johnson 1989). 
Cooperation, however, w’as generally more effective than 
either competition or individual work in producing desired 
outcomes. Fifty percent of the studies produced statistically 
significant effects in favor of cooperation; only 10 percent 
favored competition or individual effort. 

The meta-analysis showed that cooperative learning, as 
conipaied to competitive or individual learning, led to 
higher-level reasoning ability and greater retention of learn- 
ing lor students at all levels of schooling. Students showed 
both movement among Piagetian stages of cognitive devel- 
opment and an increase in their level of moral reasoning. 
These effects are induced, not by discussion among stu- 
dents per se, but by intellectual conflict between alternative 
explanations — argument and counterargument. Learning 
that occurs in groups can transfer to individual students 
when they are tested later by themselves. The difference in 
impact between cooperative and individual learning is par- 
ticularly notable for the higher-level thinking skills of analy- 
sis, synthesis, and evaluation as compared with low-level 
recall, comprehension, and plug-and-play formula applica- 
tion (see “Understanding cognitive outcomes” on p. 41). 

Cooperative activities overwhelmingly more often had a 
positive effect on self-esteem than did competitive or indi- 
vidual activities. A number of studies in the meta-analysis 
examined the personality' characteristic of competitiveness 
versus the degree of success achieved in many diverse 
endeavors. In every case, for every group of people, a neg- 
ative correlation existed between competitiveness and 
accomplishment. Studies show'ed that competition lowers 
artistic performance and undergraduates’ ability to solve 
problems. Moreover, competition breeds a number of unto- 
ward emotional symptoms. Competition is usually adverse 
to community: For one to win, others must lose. 

A cooperative effort among students can also provide an 
opportunity to develop not only skill in critical, evaluative 
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thinking, but also skill at wliat has been called “connected 
knowing” (Belenky et al. 1986; Clinchy 1989). Rather than 
focusing on judgment and evaluation, skills of critical think- 
ing, the focus of connected knowing is on understanding 
another person and his or her perspective. Connected 
knowing or learning requires the key skills of placing one- 
self in another’s stead, of listening carefully, of hearing 
accurately how another person is reasoning, understanding 
the world, and feeling. These skills are essential today, not 
only for academic, intellectual effectiveness, but also for 
comprehending and having an impact on an increasingly 
diverse, fractious, and violent world. They are essential for 
building community. 



The Role of Students’ Active Involvement 

Considerable research over the last three decades has 
explored the relationship between students’ active involve- 
nient in college — with academic work, intellectual issues, 
the faculty, and other students — and the development of 
various outcomes (AvStin 1977, 1984, 1993; Feldman and 
Newcomb 1969; Pace 1984, 1990; Pascarella 1985; Pasca- 
rella and Terenzini 1991). Based on a review of 2,600 em- 
pirical studies of college’s effects on students, "One of the 
most inescapable and unequivocal concliisions ... is that 
the impact of college is largely deteimined by the individ- 
ual’s quality of effoit and level o^ involvement in both aca- 
demic and nonacademic activities” (Pascarella and Teren- 
zini i991, p. 610). 

Involvement with people is one of the most important 
ways of inducing student development in college. Informal, 
out-of-class contact between students and faculty is corre- 
lated with many important outcomes, such as intellectual 
level, interpersonal skills, educational aspirations, autonomy 
and independence, and attainment and interest in scholarly 
careers (Pascarella and Terenzini 1991). “The most influen- 
tial interactions appear to be those that focus on ideas or 
intellectual r. alters, thereby extending and reinforcing the 
intellectual goals of the academic program” (p. 620). 

A study involving 24,847 students. 146 input varial4es, 

192 college environment (process) variables, and 82 student 
outcomes (having statistically removed the effects of the 
input and environmental factors) concludes: 
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Student-faculty mteraction has significant positive corre- 
lations with every academic attainment outcome . . . , 
evety self-reported area of intellectual and personal 
growth, as well as with a vanety of pejsonality and altitu- 
dinal outcomes . . . and . . , all self-rated abilities excej>t 
physical health (Aslin 1993, p. 383, emphasis in the 
original). 

Thus, “fre<|ueni interaction between faculty and students" is 
desirable vp. 384). 

Interacton between and among students shows a similar 
effect on development. “Once again, ... a pervasive pat- 
tern of po:'itive benefits [is] associated with frequent student- 
student interaction” (Astin 1993, p. 385). “The student s 
peer group is the single most potent source of influence on 
growth and development during the undergraduate years' 
(p, 398), and efforts “to find ways to engage students in 
extracurricular activi ies” (p. 386) are valuable. 

The concepts of students’ involvement (Astin 1984) and 
their quality of effon (Pace 1984) are similar to integration 
in campus life (Pascarella and Terenzini 199D, an impor- 
tant means for retaining students on campus until gradua- 
tion (Tinto 1987, 1993). Put anouier way, in addition to its 
potent direct developmental effects, the involvement of stu- 
dents can serv'e to retain them on campus, an obvious pre- 
condition of development. “Involvement indices make up 
one of the most important and perhaps accurate ways ot 
assessing quality” on campus (Kuh 1981, p. 2). 

On the basis of these lines of research (and others), stu- 
dents of human development today generally view the 
process of cognitive development as a gradual one in 
\\'hich students constaict an increasingly complex, finely 
textured, and abstract personal reality'. This construction of 
knowledge can be envisioned as occurring through an 
active, dialectical process w'hereby a student continually 
interacts with his or her environment. The interaction can 
involve the interposition of concepts within a student’s own 
mind or external phenomena, including other people 
(another student or a teacher). In college, as in life more 
generally, the process of constaiction often involves twc' or 
more peoi:)Ie working together to understand and solve 
prol:)Iems — to make meaning. 




Conditions for Educational Quality: A Summary 

A number of specific conditions, generally agreed upon by 
researchers (see Astin 1993; Chickering and Gamson 1987, 
1991; Pascarella and Terenzini 1991; Study Group 1984), 
are thought to foster the development of these key college- 
and university-level competencies. 

1. Challenge. Students need to be provided with activities 
aimed just above their current levels of cognitive 
development so they can both understand and be 
challenged by them (Sanford 1966). These activities 
can set up important tensions or conflicts — cognitive 
dissonances — with students’ current understandings 

of the wc..d and thus have developmental value by 
stimulating them to take one step beyond their pres- 
ent level. 

2. A supportive eyivironment . Both intellectual assistance 
in comprehending and emotional support when re- 
flecting are required from teachers and peers alike 
(Sanford 1966). The cognitive changes students experi- 
ence during development can lead to considerable 
inner turmoil as one view of the world is challenged 
and gradually replaced by another, I'he risks of dam- 
aging self-esteem, stalling development, or provoking 
outright retreat from painful confrontations with the 
world are always present (Ferr>^ 1970, 1981). 

3. Sustained, diverse, and appropriate active involvement 
in learning. Students should be kept busy reading, 
writing, solving, designing, and interacting coopera- 
tively with peers and professors, both in class and 
outside of class, and reflecting on these experiences. 
They should be kept constantly thinking and feeling. 
Two fundamental principles underlie the conditions of 
educational excellence (Study Group 1984), First, ‘the 
amount of student learning and personal deveU^pment 
associated w'ith any educational program is directly 
proportional to the cjuality and quantity of [students'! 
involvement in that program,” and, second, "the effec- 
tiveness of any educational policy or practice is di- 
rectly related to the capacity of that policy or practice 
to increase [students*] involvement in learning*’ (p. 19). 
Students learn what they study. 
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4. High expectations. Expeciaiions for quality of educa- 
tional outcomes should be high. Considerable research 
has demonstrated that hard, challenging goals can sub- 
stantially increase one’s productivity, while no goals or 
easy goals may actually set low ceilings for perfor- 
mance and thus actually retard quality of effort (Locke 
and Latham 1984, 1990), 

5. Clearly defined outcomes, frequent assessment, and 
prompt feedback. Knowing clearly wdiat desired out- 
comes should be and having specific and timely 
knowledge of actual results achieved contribute pow- 
erfully to improving performance (Locke and Latham 
19H4, 1990). Students need to know what they should 
know and be able to do and, on a regular basis, how 
w'cll they have succeeded in their efforts. 

To what extent do our current practices in colleges and 
universities capitalize on this valuable knowledge about our 
students? To what degree do we now use methods that are 
known empirically to w'ork? Do our educational processes 
conform to what experts today regard as high-quality, ac- 
cepted professional practice? What is the quality of the out- 
comes we produce? Can we improve the quality of our 
educational processes by applying this research more 
actively and thus significantly improve the quality of 
our results? 

The next four sections examine research exploring four 
core components of students’ experiences on campus that 
are central to their development and therefore critical to 
maintaining and improving an institution’s quality: curricu- 
lum, instruction, psychological climate of the campus, and 
academic advising. 
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THE CURRICULUM; Framework for Development 



Based on an institution’s own values and philosophy, the cur- 
riculum determines the pattern of courses a student takes 
and should thereby ensure, for each person, the intellectual 
ligor, depth, and balance among the types of learning needed 
for his or her effective personal and professional develop- 
ment. Students need to learn concepts and principles, to 
develop cognitive and motor skills, and to develop attitudes 
and values that will be important to them and to society. 
Central to their success is the selection of particular courses 
that will provide specific, developmentally appropriate expe- 
riences. The curriculum should be more than a sum of con- 
stituent parts. In both general education and a student’s 
major field of concentration, it should ser\^e as a map to 
integrate its parts and help construct a coherent, thought-out 
view of self and the world. 

To what extent do students now engage in such experi- 
ences in a planned and systematic fashion? To what degree 
does the curriculum foster the kinds of learning most im- 
portant for each person? Providing definitive answers to 
these questions has been difficult. Research on the structure 
and effects of curricula is limited (Stark and Lowther 1986). 
Relatively little research exists on patterns of courses taken 
and the specific outcomes these courses produce. The 
prevalent way to view the college curriculum refers to its 
intentions, not (cf. p. 8) . . . its results" (Ratcliff and 
Associates 1990, p. 7). Although without research we can- 
not be sure our in-tended outcomes become our actual 
outcomes, it is generally perceived that U.S. college and 
department curricula generally are much less effective and 
efficient than they might be. 

Difficulty in understanding the effectiveness of curricula 
is more basic than a lack of social science research, how- 
ever. Few institutions specify in clear detail their intended 
educational results or outcomes — what their graduates 
should know and be able to do. Moreover, because most 
do not systematically assess how much their students have 
learned through their curricula, few colleges and universi- 
ties have an accurate idea of their actual educational out- 
comes or results, much less which curricular processes 
have produced them. Assessment, of both outcomes and 
educational processes, can demonstrate tha die curriculum 
is having its intended effects. The following discussion 
review's findings of some of the limited studies available 
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that suggest answers to several key questions about college 
and university curricula. 



Design of the Curriculum: Focusing on 
Students’ Development 
Do distributional curricula serve students* 
aevelopmental needs? 

Tlie 'distribution'’ system of general education curricula, in 
which students fulfill requirements for graduation by choos- 
ing from menus of courses, is used by over 90 percent 
CAstin 1993) to 9"7 percent (Hutchings, Marchese, and 
Wright 1991) of U.S. colleges and universities. A majority of 
these curricula arc similar to each other. In a study of 303 
institutions with distributional curricula, over half (53 per- 
cent) of the curricula could not be “distinguislied by any 
unique features" (Hurtado, Astin, and Dey 1991, p. 145). 

Distributional curricula ordinarily provide students with 
consideral:)Ie latitude wlien choosing their courses. High- 
quality, development-oriented academic advising is there- 
fore essential to enal:>le our diverse, cjften seriously under- 
prepared and naive, students to choose wisely among 
potentially confusing curricular options so they can meet 
their own developmental needs. 

A comprehensive national study of thousands of students 
found, for curricula that allowed students to choose among 
various distributional general education courses, that the 
specific curricular stmeture in an institution made little dif- 
ference for most of the 22 general education outcomes 
studied (Astin 1993)- The types and breadth of courses 
available to students, the specific courses included in a cur- 
riculum, and the relative freedom of choice had no “sub 
stantial effect on how students develop" (p. 425). Astin 
found, however, that a "true- core” interdisciplinary curricu- 
lum, characteristic of fewer than 2 percent of the hundreds 
of institutions in his sample, where all students take the 
same, identical general education courses, did have a posi- 
ti\e effect on many developmental outcomes, as w'ell as on 
several aspects of students' satisfaction with college. “Most 
of these effects appear to he uniquely attributable to having 
a tnic-core curriculum" (p. 332). Astin suggests that, consis- 
tent witii his overall finding of a powerful influence on a 
student by his or her peers, “the beneficial effects of a true- 
core airnciiliim may he mediated by the peer group . . . 
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(by providing) a common experience that can stimulate stu- 
dent discussion outside class and facilitate formation of 
strong bonds among student peers” (p, 425). In other 
words, “how the students approach general education (and 
how the faculty actually deliveriho curriculum) is far more 
important than the formal curriculum content and structure” 
(p. 425, emphasis in the original). 

This true core may lead to learning that is superior to 
that produced by distributional curricula through adapting 
more effectively to students' diverse needs by providing the 
more frequent student-student contact and peer-based 
learning that may come through this w'idely shared, com- 
mon educational experience. Such experiences therefore 
may not only lead to the development of a higher level ot 
cognitive skill but also foster a stronger sense of commu- 
nity on campus, which may in turn produce the positive 
association Astin found between a taie-cc^re curriculum and 
students’ satisfaction with and staying in college. 

A study of the gains made in specific competencies at 
“Western University,” a private research universit>\ by grad- 
uating seniors who had scored relatively high or relatively 
low on their SAls found that various groups of courses 
were correlated with gains, or declines, in specific compe- 
tencies for high- and low'-ability groups of students (Jones 
and Ratcliff 1990). The researchers suggest their results are 
consistent with and support the development of different 
curricular patterns for various types of students, depending 
on the specific competencies to be developed. This re- 
search docs not support the developmental value of distri- 
butional curricula, but it does emphasize the importance of 
adapting curricula to the individual needs of different kinds 
of students. 

[It] does )iot siippofl the ciurerU use of a wide range of 
options in a distributional general education require- 
ment. Instead, it suggests that discrete TxvvAys of coune- 
work be identified [that! are more approphate and pro- 
ductive for different ability levels of students. ... In the 
majority of cases, Western U>vvefsity coursework chosen 
by high -ability students led to gains in learned abilities, as 
measured by the CRE. The converse was true for the low- 
ahility students; here the majonty of coursework chosen 
did not lead to gains in general learn i?ig. Xerertheless, 
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discrete sets of coiirsework were identified that were bene- 
ficial to these students. These results suggest the need for 
greater academic advising in the undergraduate course 
selection or greater prescription in the curriculum Qones 
and Rarcliff 1990, p. 37, emphasis in the original). 

Unfonunaiely, academic advising at most institutions 
lacks a developmental focus (see ‘’Academic Advising: 
Guiding Development" beginning on p. 87). Students often 
pick courses without the essential developmental context 
skilled guidance could provide. Lack of careful advising, 
coupled with ill-defined outcomes for both curricula and 
courses, may have serious educational results. 

Student transcripts often reflect a sense of educational 
iraridering, if not drift. By graduation most have come to 
understand that their degrees have more to do with the 
successful accumulation of credits than with the purpose- 
ful pursuit of knowledge. At most selective institutions, 
attrition rates remain stubbornly high, with most of the 
loss occurring in the first year of instruction (’’Learning 
Slope" 1991. p. 5A). 

At far too many institutions, the distribution requirements 
of general education are unfocused. They encourage ran- 
domness, not coherence . . (Boyer 1990a, p. 14). “We’re 
kind of like a MeUniversity, .\ smorgasbord of fast food," 
one student told Carnegie researchers. 



Are liberal arts programs practical? 

A few studies compare outcomes for students in liberal arts 
curricula with those in narrower, vocationally oriented pro- 
grams. In one study, an emphasis on liberal arts signifi- 
cantly increased African-American male students’ choice 
of higher prestige, more demanding, and typically white 
careers, and attending a liberal arts college increased 
women’s selection of gender-atypical careers (Pascarella 
and Terenzini 1991). In another study, students enrolled in 
liberal arts curricula showed over tw'ice the reduction in 
authoritarianism of other students. Although, as first-year 
students, they started with lower scores on authoritarianism 
than nursing ancl business majors, the decrease in the 
scores of liberal arts majors over four years of university 
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coursework was “particularly dramatic ... and significantly 
greater than the others” (Aitenieyer 1988, p. 92). 

Liberal arts students also show greater gains in moral 
judgment (McNeel 1994). In fa^'l, some vocationally oriented 
major programs may actually produce a decrement in moral 
development. “Business and education majors were much 
more likely to show significant decreases in principled rea- 
soning” (McNeel 1994. p. 34). Accounting majors generally 
have lower scores on moral judgment than other, nonbusi- 
ness majors in several studies (Ponemon and Gabhart 
1994 ) — with even lower scores found among senior ac- 
countants and partners in CFA firms. In other studies, "... 
veterinary medical education appears to inhibit the in- 
crease in moral reasoning ...” (Self, Olivarez, and Bald- 
win 1994, p. 166), and medical students tended not to 
increase in the quality of their moral reasoning (Self and 
Baldwin 1994, p. 160). What may be the impact on society, 
especially on its school children, if vocational curricula 
preparing teachers and other professionals retard their 
moral development? I'he potential for moral development 
in college is suggested by average effect sizes revealed to 
be among the largest college impacts examined (McNeel 
1994). What would be the effects on societ)' if we agreed 
to define moral development as a formal outcome goal and 
resolutely set about to produce it acrc^ss the curriculum? 

While careful design of the curriculum can lead students 
through a rational and relevant sequence c^f experiences 
that can lay out for them a clear and appropriate develop- 
mental map, the results of a detailed study by the Associa- 
tion of American Colleges of curricular focus, breadth, and 
depth based on the transcripts of all 19,086 1987 graduates 
from 30 diverse colleges and universities suggest that "the 
undergraduate curriculum in the liberal arts lackls) . suf- 
ficient breadth of study, particularly in the natural sciences 
and mathematics, and . . . substantial depth . (Zemsky 
1989, p- 36). "In common sense terms, there is a notable 
absence of structure and coherence in college and univer- 
sity curricula” (p. 7). 

Do students share a common educational experience? 

Are certain outcomes t)f such personal and social impor- 
tance that all students should ha\e achie\etl them? Are cer- 
tain formative experiences for students so central to their 
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development that everyone should share them? If co^^^non 
learning is important, is the curriculum now providing it? 
And do otlier curricula provide for students the important 
shared experiences of peer groups suggested for true-core 
curricula? 

Students at the previously mentioned “Western Univer- 
sity’’ shared very little of their formal learning with each 
other (Jones and Ratcliff 1990). Only 15 to 20 percent of a 
student’s courses were taken in common with at least five 
other students in the same high- or low'-ability sample of 
students. Thus, although diverse curricular options can he 
an institutional strength, it can also be a weakness. The 
central concern is the extent to which diversity in the cur- 
riculum enhances or dilutes the quality of student out- 
comes. The good eHects ol a “tai e-core” curriculum relative 
to distributed curricula stand out prominently here. 

One striking discontinuity in students’ educational experi- 
ence emerges from an analysis of transcripts including 
485.000 courses taken by 12,600 American undergraduates 
(Adelman 1990). Men and women students take very differ- 
ent sets of courses: "From high school through graduate 
school there is a men s curriculum and a women’s curricu- 
lum' (p. 2^2). And nearly two-thirds of the 82 college out- 
comes in fme .study reflected “significant gender effects” 
(Astin 1993) What might he the implications for students' 
and society’s development of such a striking disjunction in 
the college experience? 

Effects of the Curriculum’s Courses 
Should “general education** be confined 
to the first two years? 

S<mie four-year institutions enccuirage students to finish 
their required general education cxiur.ses during their first 
two years. Often students regard m<\st (if the curriculum 
not related to their major as a necessary e\ il. as something 
they must sit through to get a college degree (Moffatt 1989, 
p. 282). In a survey of Harvard seniors who expressed dis- 
appointment w ith their courses, however, almost every’ one 
'chose cla.sses in [ihel fresliman year 'to get the retjuire- 
ments out of the way"’ Haght 1992. p. 53). Many students 
do not understand the importance of the general education 
t urricLilum, possibly because of poorly definetl ouitomes 
and lack of devclojimental acatiemic advising. 
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Beyond the unfortunate implication of the personal irrele- 
vance of general education compared to the more narrow, 
specialized, and professionally oriented learning associated 
with a major, if our focus is on students’ development 
rather than the mere fulftllment of requirements, such a 
policy could be counterproductive. Wliile certain important 
competencies are developed in lower-division courses, 
upper-division courses “[contribute] strongly to the develop- 
ment of specific learned abilities, particularly analytic rea- 
soning” (Jones and Ratcliff 1990, p. 3B). Quantitative abili- 
ties, for example, are developed not only by lower-division 
mathematics courses, but also in certain applied courses in 
business and in the natural and social sciences, suggesting 
that general education “should . . . extend vertically, from 
the freshman to the senior years” (Boyer 1987, p. 101). The 
slow development of higher-order cognitive skills and other 
important, slow-to-develop skills should be fostered delib- 
erately — in general education courses and in the majcx as 
well, and not only during the first and second years, but 
throughout the college experience. 

What is the role of introductory courses? 

Introductory' courses underpin a student's understanding of 
the various disciplines and professional fields, and many 
students never take later, advanced courses in fields outside 
their majors. Yet most faculty in a national study said mate- 
rial that would familiarize students with the modes of in- 
quiry' ehanicteristic of their fields should be left for advanced 
courses (Stark et al. 1988). If faculty practice what they 
believe, how can the undergraduate general education cur- 
riculum enable students to understand and use effectively 
the diverse epistemologies of these fields? In most cases, 
are these ways of reasoning not precisely the most impor- 
tant contributions to the curriculum expected of these 
introductory' course .s? 

Do required courses have their intended effects? 
Although the actual assessed achie\'ement of outcomes for 
students in one study at four diverse institutions was not 
necessarily related to the courses recjuired by' the institu- 
tion, it was relatetl to other patterns of courses (Ratcliff anti 
Associates 1990) And our general failure to specify clearly 
the outcomes or results we expect from either curricula or 
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courses could be significant here: Planning, implementa- 
tion, and assessment become difficult without clear direc- 
tion. (See also “Instmction: Teaching, Testing, and 
Communicating Outcomes’' beginning on p. 37 for other 
possible reasons for this disjunction between curricular 
requirements and results.) 

Overall Effects of the Curriculum 

How much is learned through the curriculum? 

A study of the transcripts of 73 graduating university 
seniors, some of whom had high scores on their SATs and 
some of whom had low scores, tiiat involved over 4,000 
courses examined students’ ‘general learned abilities” upon 
graduation (Jones and Ratcliff 1990). Students* abilities were 
a.s.ses.sed by GRE general test res Uts after the effects of pre- 
cf41ege learning, as assessed by tlie SAT, were statistically 
removed. The study revealed that, once students’ precol- 
lege learning had been removed, neither students in the 
high-score group nor the low-score group showed strong 
positive gains horn their college experiences. In both 
groups, some students had gained in general learned abil- 
iry', while others had actually declined in ability. The results 
of the study led the inve.stigatc^rs to conclude that the aver- 
age student at that university did not select coursevvork 
as.sociated “with gains in general learned abilities” (p. 20). 
They further concluded that different curricular patterns 
could contribute to general learned abilities in different 
ways and that courses at different le\'els throughout the 
curriculum are correlated with gains in students’ abilities. 
Similarly, some groups ol courses were associated with 
declines in sped lie abilities, such as analytic reasoning. 
I-urtiier research would be required to explain why certain 
courses are associated with gains or declines in particular 
competencies. 

What does a transcript of courses signify? 

I he research review'ed here calls into .serious question the 
w ide.spread practice of meciianically certifying .students for 
graduation on the basis of the number of credits they have 
accumulated. 'Hie effects of individual courses on different 
Students can Ik* quite di\erse. I*or example, students are at 
\’erv* diherent stages with respect to a number of dimen- 
sions of their development and thus their capacity to 
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understand and profit from specific courses. “Exposure" to 
these activities is not enough. “Simple counts of the num- 
ber of credits or courses a student has taken in a particular 
subject may not be a reliable proxy of general learning in 
the attendant subject area” (Ratcliff and Associates 1990, p. 
43). More effective would be the use of high-quality devel- 
opmental advising coupled with defining clearly the specific 
competencies to be developed — student outcomes rather 
than educational processes — and then assessing achieve- 
ment of the actual outcomes. Here the emphasis is placed 
squarely on results of both students and institutions rather 
than on the time spent in courses. 

How ivell do our curricula serve society*s needs? 

America’s college curricula undenial:>ly play a key role in 
ensuring society’s well-being. Much evidence now suggests, 
however, that they are not contributing what they are capa- 
ble of and what is needed. 

Much about postsecondary learning is inappropriate for 
adult learners . . . , fincliidingj insufficient individualiza- 
tion, needless repetition, and inadequate recognition of 
prior learning. . . . Higher education institutions them- 
selves remain a major impediment to addressing the 
nation's needs Jor resources for adult learning. . . . There 
is significant resistance in many four-year colleges and 
universities to making the accommodation necessajy 
(Commission on Higher 1984, p. 7). 

Further, a consortium of top-level leaders in American 
higher education notes that although “there has been 
great interest in curriculum revitalization, the sense lingers 
that results have been disappointing. Core issues have too 
often l^een avoided. Hodgepodge courses and experiences 
have passed for undergraduate education” (Irvine Group 
1990, p. 2). 

Over the past decade, undergraduate renewal has relied 
on c utricular patterns that have not worked well. Out- 
moded distribution requirements, for example, where stu- 
dents select courses from broad academic fields, usually 
have failed to accomplish what is intended. These courses 
amount to electives, not general education. . . . Merely 
reconfiguring the undergraduate curriculum, dropping 




Once students* 
precottege 
learning had 
been removed, 
neither 
students in 
the high-score 
group nor the 
low-score 
group showed 
strong 

positive gains 
from their 
college 
experiences. 



Redcsifiulitfi Hiffher Ldu<.ali<jii 



33 




or adding elements without addressing fundamental op^ 

ics, achieues little ip. 2), 

To express its percei/ed incoherent, hodgepodge character, 
this distril;)ution system has been variously and irreverently 
dubbed a supermarket, cafeteria, grab bag, or green-stamp 
endeavor (accumulate credits, paste ’em in, and redeem 
’em for a diploma). 

Although prominent critiques of college curricula are per- 
haps most widely known (e.g., Project on Redefining 19H5), 
concern about curricular quality is not limited to general 
education, the liberal arts, or the undergraduate level. Many 
specialized undergraduate and graduate curricula, from 
accounting to veterinary medicine, have been criticized as 
well (see, e.g., Evangelauf 1989 and Wyer 1993 [account- 
ing]; American Institute 1990 and Committee on Education 
1984 through 1990 [biology]; Field 1995 [dentistryl; American 
Economics 1990 [economics]; Blum 1992, Johnston, Sha- 
man, and Zemsky 1987, and "Universities Need” 1995 [engi- 
neering]; Commission on Admission 1990 [graduate man- 
agement]; ‘‘Better History" 1992 [history]; Project on the 
FTiture 1984 [journalism]; Burrows 1990 and Panel 1984 
[medicine]; Project on Liberal Education 1990 [natural sci- 
ence]; Altman 1989 [premedicine]; Holmes Group 1995, 
Lively 1993. Olson 1986, and Winkler 1985 [teacher educa- 
tion]; Aerospace Education Foundation 1989 [technology!; 
and Monaghan 1988 [veterinary medicine]). 

Conclusions 

Although much more research is needed to help us under- 
stand the effects of curricula, the results reviewed here are 
both instructive and consistent. This research suggests that 
college and university curricula, as they now function, in 
many cases do not produce the results we intend and that 
‘‘the curriculum is no longer achieving its intended pur- 
po.se" (Fife 1991, p. xiii). In most cases, curricula unfocused 
by clear .statements of intended outcomes that permit naive 
students broad choices among courses result in markedly 
different outcome.s from those imagined. 

We should pay much more attention to the way the cur- 
riculum is pre.sented and how students interact with it 
(A.stin 1993). Institutions need far better information about 
their student.s developmental needs as they enter the insti- 
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tution and their achievement as they move through their 
curricula- Essential are a clear definition of intended out- 
comes, knowledge of how' each course or curricular com- 
ponent interacts with students’ developmental levels, learn- 
ing styles, developed competencies upon entrance, and 
other important variables, and specific information on how' 
these components contribute to each outcome produced. 

Do some courses contribute especially to the de\'elopment 
of important oiac<^mes? Do some contribute little? Do cer- 
tain groups of courses, when taken in sequence, have 
predictable, significant effects on students' development 
greater than the sum of tlieir individual contributions? 
Regular assessment is essential to students’ development. In 
addition, advising must l^e far more sopliisticated to orient 
and guide our widely diverse students as tliey constmet 
curricular paths most appropriate to their individual 
development. 
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INSTRUCTION: Teaching, Testing, 
and Communicating Outcomes 



What Do We Teach and What Do They Learn? 

A college’s courses are the flesh on its curricular frame, and 
curricula produce their developmental effects through the 
courses they comprise. A larger and more specific body of 
research exists on instmction than on curricula. This section 
reviews studies related to several key aspects of instruction, 
each of which has important effects on our capacity to pro- 
duce learning: instmctional methods and the intellectual cli- 
mate and degree of active involvement students experi- 
ence; the quality of assessment of learning outcomes; and 
faculty grading practices, 

What professors and students do in the classroom 

Courses are a college’s primary means for helping students 
to develop. Many instmctional methods are available today, 
and the efficacy of a number of them for enhancing stu- 
dents’ development is well documented. To what extent do 
the courses \vc teach employ established principles of qual- 
ity instmction — principles of professional practice accepted 
by experts? In other words, to what degree are the courses 
we teach characterized by clearly defined outcomes, effec- 
tive means of assessing results, and timely feedback for stu- 
dents on their progress; high expectations; a challenging 
environment for the development of higher-order skills; 
and a sustained high level of diverse and active involve- 
ment in learning for .students? 

Instructional design. High-quality instructional design is 
characterized by, among other features, clearly stated out- 
come goals and objectives that describe the specific curric- 
ular outcomes a course attempts to produce; it is also char- 
acterized by the educational activities capable of develop- 
ing them, A national study of faculty teaching introductory 
courses reweals that effective thinking was the “overvviielm- 
ing choice” of educational purpose stated by respondents 
(Stark et al. 1990). When asked open-ended questions 
about goals for their courses, however, of 4,000 goals pro- 
vided by these same faculty, the most frecjuently mentioned 
was “teaching the concepts of the field ’; relatively few 
goals mentioned intellectual development. In addition. 

“very few faculty members contributed goals focused on 
vahie development or ‘learning the great ideas of human- 
ity’” ( p. 115). Detiiiled interviews with H9 faculty members 
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about the processes they use to plan courses found only 35 
percent strongly emphasized their program’s or the col- 
lege's curricular goals, only 12 percent used feedback from 
previous students, and 8 percent emphasized the views of 
experts in instaiction (Stark et al. 1988). Further, “they 
rarely mentioned making choices among alternative instruc- 
tional strategies” (p. 227). Thus, “the faculty interviewed 
seemed to teach as they had been tauglit and to Iiave 
acquired course-planning skills on the job” (p. 227). 

The Lecture System. A study of nearly 1,800 faculty mem- 
bers at live diflerent types of institutions found that, regard- 
less of institutional type (large or small, public or indepen- 
dent, community college or research university), an average 
ol 73 to 83 percent of respondents chose the lecture as 
their principal instructional metliod over discussion, recita- 
tion, lab/shop, applied instruction (in music), and individu- 
alized instaiction (Blackburn et al, 1980). “Give . . . faculty 
almost any kind of class in any subject, large or small, 
upper or lower division, and they will lecture” (p. 41). 
Other studies have repeatedly confirmed the perv'asiveness 
of the lecture. Recent re .search by Thiele ns found the lec- 
ture method was the modal instructional method used bv 
"89 percent ot the physical scientists and mathematicians. 

81 percent of the social scientists, and 6l percent of the 
humanities faculty (although 81 percent of the art historians 
and 90 percent of the philosophers lectured)” (Bonwell and 
bison 1991, p. 3). A report by the Association of American 
Medical Colleges points out that 37 percent of North 
American medical schools scheduled over 1,000 hours of 
lectures fc^r the first two-year, preclinical medicine curricu- 
lum, and another 42 percent scheduled betw'een 800 and 
1,000 hours (Panel 1984). With “abundant evidence (indicat- 
ing] that the educat onal yield from lectures is generally 
low" (p. 12). the report recommends reducing .scheduled 
lectures by cMie-third to one-half and allowing students 
unscheduled time for more productive learning activities. 

Since the medieval universities of Paris and Bologna 
(Haskins 1957), the lecture has shown remarkable* durabil- 
ity’ in the face of technological advances and the often 
sharp attacks of its critics, themselves dating back almost as 
far (McLeish 1968). But how effective are lectures in fo.sicr- 
ing impv)rtant outcomes for .students? A re\ iew of five dif- 
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ferent studies concludes that students learn more from 
reading complex material than they do from listening to 
lectures about it (Davis and Alexander 1977a). Further, two 
of the studies reviewed conclude that the process of trying 
to take notes from a lecture, although useful for aiding 
recall later on and in raising test scores, can interfere with 
immediate retention of information communicated in a lec- 
ture (Davis and Alexander 1977a). 

A review of 17 studies comparing lectures to discussions 
ccincludes that lectures are as effective as discussions for 
learning low-level factual material (McKeachie 1986), but 
research clearly favors discussion over the lecture as an 
instructional method when the \'ariables studied are reten- 
tion of information after a course is over, transfer of knowl- 
edge to novel situations, development of skill in thinking 
or problem solving, or achievement of affective outcomes, 
such as motivation for additional learning or change in atti- 
— in other words, the kinds of learning w'c most care 
about. A review of seven additional studies (Davis and 
Alexander 1977a) supports this finding, 

Other studies suggest further limitations of lectures as 
means of student development. A review of four studies 
(Davis and Alexander 1977a) reveals that students who 
benefit most from lectures are those who are “brighter," 
better educated, and from families of higher socioeconomic- 
status. in othc^** words, presumably those students with rela- 
tively highly developed abstract reasoning skills. (The stud- 
ies on which these statements are based were all com- 
pleted when students were better prepared for college than 
they often now are, long before the opening in the 1960s 
and 1970s of colleges and universities to all citizens, and 
the appearance on campuses of large numbers of students 
from disadvantaged backgrounds.) But two other studies 
cited by Davis, Vt)\ and Alexander (19“'7) suggest that even 
more aiile students gain more from discussions than from 
more directive methc^ds. such as lectures. 

Virtually civty uunlcl/nr teaching thinking anJ fostering 
intellectual develofmwnt adrocates extensive student- 
teather and student-student discussion. But engaging stu- 
dents in classroom diahgue is not alirays easy Dialogue 
in c\)llege classrooms is scarce: teachers (fue.'it ions are 
dominated hy reefuests for factual information (lass 
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discussions often slay at the level of "quiz shows, ” "ram- 
bling hull" sessions, or "wrangling bull" sessions iK.uTi'\ss 
1988, p. 66). 

In a “quiz show," teachers merely ask students for informa- 
tion and, by doing so, may reinforce a concrete, fact- 
oriented, dualistic epistemology. “Rambling bull session.^ ' 
consist of students multiplistically sharing unchallenged 
opinions, wrangling bull sessions” of students dogmatically 
arguing their opinions on a controversial topic. Both types 
of bull sessions may reinforce rather than challenge cogni- 
tively simplistic dualist or multiplistic epistemologies by fail- 
ing to demand carefully reasoned contextual evaluation of 
evidence. 

Samuel Johnson long ago produced his own straightfor- 
ward critique of lectures: 

People have now adays . . . got a strange opinion that 
every thing should be taught by lectures. Now, I cannot 
see that lectures can do so much good as reading the 
books from which the lectures are taken. . . . Lectures 
were once useful- but now, when all can read, and honks 
are so numerous, lectures are unnecessary lV,os\vti\\\ life 
of Samuel Johnson, LL.D., pp. 144, 471).* 

The intellectual climate of the college classroom 

Among the outcomes most widely desired by faculty, and 
of highe.st value to both students and society, are tile higher- 
order cognitive skills and dispositions of critical thinking, 
cermplex problem .solving, and principled ethical reasoning. 
These abilities and orientations clepend on high levels ol 
ab.straction and are characterized by their use of analysis, 
synthesis, and evaluation. The.se skills require for their 
development the explicit teaching of specific ways of think- 
ing (heuri.stics), copious practice (students' active involve- 
ment), frec|uent as.sessment of progress, and timely correc- 
tive feedback (McKeachie et al. 1990; Woods 1987), Whai 
does research tell us about the effect ivene.ss of college 
courses in fostering intellectual development? Are .some dis- 
ciplines more productive than others? Do the intellectual 
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challenges we give our students increase as the semester 
progresses? Are tl^e cognitive demands more rigorous in 
advanced than in lower-level courses? Does class level or 
institutional size or type make a difference for students' 
intellectual experience? 

Understanding cognitive outcomes. In an attempt to 
clarify thinking and communication, many have tried to 
classify the specific competencies we seek to develop in 
students (Lenning 1977), The model of cognitive behavior 
that has received the widest use in educational planning 
and practice — and that has over the last fcnir decades 
become for many educators one of their most highly val- 
ued professional tO(ds — is the Taxonomy of Kducatic^nal 
Objectives or ‘*Hloom Taxonomy*’ (Bloom 1956). This 
model is commonly used in the research discussed in the 
following paragraphs and thus is briefly described here. 
Teachers can also easily use to good effect the technk|ues 
found in these studies when defining their intended out- 
comes as learning objectives and when assessing the actual 
outcomes their courses produce. 

The taxonomy organizes cognitive behavior intf^ six levels. 

1. Knowledge, here referred to as /?ecY^// (Paul 1995. 
chap. 10), requiring memory alone; 

2. Comprehension, which includes accjuisitif)n of concepts 
and principles. 

3. Application, in which concepts and principles are used 
in new, albeit straightforward situations; 

4. Analysis, which involves the disassembly of wholes io 
identify their cemstituent parts, themes, (^r organizing 
principles; 

5. Synthesis, in which novel whedes are assembled fnmi 
pans; and 

6. Hi valuation, w hich invoh es judgment of relative value 
or quality. 

The last three levels are all involved in critical thinking and 
complex problem solving, including principled etliical rea- 
soning. They are thought of as con.stituting higher-order 
intellectual processes — the skills we value most. 

Tfic taxonomy i.s valuable lor our work as teachers. Vt’ith 
its use. any question asked c:f or by a .student, or any pr()b- 
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lem. activity, or assignment, can be rated as to its probal^le 
cognitive rcquirc*ments for a successful answer or solution 
or its completion. The taxonomy has long been used to 
control the cognitive level of each item in assessments o* 
students’ learning. Collectively, a test’s overall cognitive 
demands can be determined directly and easily. 

Students’ active involvement with thinking. >X'hen stu- 
dents are in class, Iiow much of tlie time are they actively 
involved in thinking? Is the time they spend in class corre- 
lated with the development of their cognitive skills? A 
series of studies of the verbal and intellectual dynamics in 
various undergraduate and graduate learning situations pro- 
vides insight into the cognitive character of our instruction 
(Idlner and Barnes 1983). 

An analysis of audiotapes ol 155 class sessions in 40 
undergraduate courses at two private and two public insti- 
tutions used a modified version of the Taxonomy of Hd cl- 
eat ional Object iv-'es to examine the intellectual climate and 
the quality of questioning in the classes (Fischer and 
Grant 1983). Talk in the classroom primarily involved the 
transmission of tacts; recall-level discussion was almost 
twice as common as discussion rated at all five other cog- 
nitive levels together. I’his result held true regardless of 
discipline, time in the semester, or institutional size. 

Although professors in classes of all sizes mostly em- 
ployed recall -lev^el discourse, class size significantly 
affccied the ('ognitive skills used by students. Students in 
small classes (15 students or fewer) used an average 
median thinking level of analysis, those in medium -size 
classes (16 to 45 students) used comprehension, and 
those m large classes (46 to 300 students) used recall. 
Thus, the thinking level expressed orally by students in 
small and medium-sized classes was higher than that of 
their professors. As proles so rs became more direct in 
their teaching style, giving students less choice on how to 
respond, students’ level of thinking decreased; as profo.s- 
sors became more indirect, students’ cognitive level rose. 

'■ Despite a ratio of 47 [studentsi to 1 [professor], profes- 
sors talked four times more fre(|uenlly than students’' 
(Fischer and C'lram 1983. p. %). Further, “as professor*^ 
talked more, .students reduced their use of cognitive 

skills" ( p. 5(>). 
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From antiquity, questions have been one of a teacher’s 
choicest professional tools. An analysis of professors’ ques- 
tioning behavior, ba.sed on the same audiotapes described 
earlier, concludes that the professors teacliing tho.se 15S 
cla.sses spent little time questioning .students (I^arnes 1983). 
The percentage of class time devoted to questioning ranged 
from 0,2 percent to 9.2 percent (if the single lowest and 
single highest percentages, 0.03 and 20.8, respectively, 
were dropped). No significant difference occurred regard- 
less of institutional type or size, level of course (beginning 
or advanced), or di.scipline. 

Questions asked in class were analyzed for the lew! 

(jf thinking skill required fcjr .students to answer them. 
Memory-level (recall) c|ue.sti(ms accounted for 89 3 percent 
of all questions asked. Re.sults did not differ between pub- 
lic and private in.stitutions or between large and .small in.su- 
Uilions, Hvaluation-level thinking, the highe.st level in the 
Taxonomy of Educational Objectives, (x'curred only 0.3 
percent to 2.5 percent of the time. 

As the cognitive le\ el of in.structcKs’ que.sticms rc^se, the 
level (T students’ responses also rc^se. As prc^fes.sors asked 
more recall-level que.stions, students' cognitive level de- 
creased. Almost a third (319 percent) of all que.stions 
asked by faculty resulted in no participation by students. 
“Not only were many of the clas.ses void of intellectual 
interchange between profe.ssor and .students, bur they also 
lacked excitement and vigor” (Barnes 1983, p. 79). Other 
studies support this finding. A .study of 19 University of 
Texa.s-Austin faculty members fou. J their mo.st common 
questions had to do with mechanical issues, such : . time 
or handouts, or were rhetorical, where .students’ respon.ses 
were unnece.ssary (Lewis 1984). Mo.st content-re' ited ques- 
tions involved recall and comprehension. 

A study of audiotapes and 138 .student q’'e.sti(mnaires 
from the cla.s.ses of 12 profe.s.sors evenly divided amtmg the 
humanities and natural and social sciences at a .small liberal 
arts college noted for its use of diverse teaching styles 
found significant changes in students’ critical thinking abil- 
ity (Smith 1983). Ba.sed on scores achieved on critical- 
thinking tests during the .seme.ster. chang s in .students’ 
ability were significantly and p' ely correlated wiili le\ - 
els of praise from faculty, inte*..cUon among students, and 
high-level cognitive responses from students in class. As 
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these latter processes rose, behaviors involved with memo- 
rizing decreased, “We can see that the amount of time 
spent listening is negatively related to change in critical 
thinking and positively related to memorizing” (p. 100). 
Students’ active participation constituted only 14.2 percent 
of the time in these classes, howev'er. Questioning (2.6 per- 
cent) and encouragement by the professor (3.7 percent) 
took up 6.3 percent of the time. Of time spent on ques- 
tions asked of students (2.6 percent), 49 percent involve-: I 
memory alone (recall); 4 percent of the questioning time 
involved questions requiring evaluation. “The differences in 
critical-thinking scores and in critical-thinking behaviors 
betw'een classes with low- and high-level participants wxTe 
dramatic. . . ” (p. 111). Although other estimates of stu- 
dents’ involvement in high school classes are far higher, 
“the active intellectual interchange, which one often imag- 
ines when envisioning a college classroom, does not take 
place on the average" (p. 110). 

A different study, of audiotapes of 19 classes from the 
liberal arts, natural science, engineering, and business col- 
leges at the University of Texas-Austin, using the Cognitive 
Interaction Analysis System (Johnson 1986, 1987a; Lewis 
1986; Lew is and Johnson 1986). found that teacher talk 
made up 88.5 percent of class time, student talk 5 percent, 
and silence, owing to pauses in what the instructor said nr 
to quizzes, 6.4 percent (Lewis 1984). Overall, the faculty 
lectured 80 to 90 percent of the time. This pattern differed 
little among the four colleges. 

Are graduate courses different? To w hat extent is the in- 
tellectual climate in graduate professional courses different 
from the one experienced in many undergraduate courses? 
Studies are few, but research in U S. medical schools 
reveals a similar pattern of students’ minimal involvemenr 
and an emphasis on memorizing facts (Foster 1983). In a 
study of the instruction of 380 faculty members at seven 
medical schools, one-third of the faculty used no “thought- 
provoking questions. Many of the professors who used 
such questions “did so in a formalized or mechanical man- 
ner — producing boredom, irritation, (and) anxiety rather 
than interest and stimulation (p, 121). Four otlier studies 
“hnind a paucity of student participation in cla.sses and an 
emphasis by the faculty on factual information rather than 




higher-order thinking. Suidenis were not challenged to pur- 
sue inquiry' in depth or to approach clinical problems with 
intellectual curiosity” (p. 121). 

Overall, medical training consists of “a multitude of dis- 
jointed facts . . . [that could] exceed what students can 
learn in a four-year period” (Burrows 1990. p. Bl), and 
tests tend to focus on facts as well. A calculation at one 
state veterinary' medical school showed students were 
required to learn 216,000 facts, or 200 facts each day. seven 
days a w'eek (Monaglian 1988). 

In summary, the research on college classes is consistent; 
Faculty' can strongly influence the amount of students’ active 
involvement and the cognitive level of the classrcx^m. Never- 
theless, faculty overwhelmingly lecture, primarily transmit- 
ting facts reejuiring low cognitive levels to students who 
function as passive listeners, Our primary' stock in trade 
might, after all, Ix^ “ inert ideas’ — that is to say. ideas that 
are merely received into the mind without Ix^ing utilized, 
or tested, or thrown into fresh combinations” (Whitehead 
1929, p l). 

The impact of our methods 

H(;w’ effectively do our current melliods keep students 
focu.sed on their tasks? To what extent do students henelit 
from our effort .s? 

How much do students hear in our lectures? If the con- 
clusions of the research reviewed above are valid, our stu- 
dents spend most of their time in cla.ss learning facts. I low 
closely do they pay attention to wiiat we are saying? How 
much of what we say do they actually hear, and how much 
of this low'-level material do students retain for use at some 
time after the cla.s.s, or course, is over? 

After only 15 to 20 minutes in a lecture, .students’ minds 
begin \n wander, and retention of information begins to fall 
off (Davis and Alexander 1977a). More recent studies con- 
firm that attention drops off after 10 to 20 minutes (Bon- 
W'ell and Hi.son 1991). A .study of both ol)scrved and selt- 
reported on-target cla.ss room (lecture) behavior found 
great ^imi!arity in obser\ed behavior among lx)th learning- 
oriented and grade -oriented students (Milton. Pollio, and 
hison 1986), Average ol)served on-target behavior — for 
example, attending to the lecturer, taking notes, or asking 
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or answering questions — was only 49 percent. About half 
the time in lectures was spent thinking about people, time, 
body, and mood; up to 15 percent of the time in class 
involved fantasy. 

How much do they remember? Studies of the retention 
of course material (Gustav 1969; McLeish 1968) at all levels 
of schooling generally show rare high values of as much as 
50 percent retained, but results frequently drop below 20 
percent (Brethower 1977). The published values for re- 
membering are probably overesdmates, as the student has 
often forgotten some information by the time the initial 
measurements are taken and presumably will continue to 
do .so after the final post-test (Brethewer 1977). 

One carefully designed study at Norwich (England) 
University tested students almost immediately following a 
specially designed lecture (.McLeish 1968). Students were 
tested on their recall of facts, theor>^ and application of 
content they had just heard, and they were allowed maxi- 
mum use of the lecture notes they had just taken, know'ing 
they would be tested, and a printed summary of the lec 
ture. The average for students' recall cT this information 
was only 42 percent. One w'eek later, a subgroup of these 
students was retested with the same test they had already 
taken, presumably making them beneficiaries of test prac- 
tice effects. Although recall among the .students v'aried 
(with some remembering three times as much as others), 
they remembered an average of only 20 percent of the lec- 
ture content, having forgotten in one week an additional 50 
[percent of what they had remembered earlier from the le c- 
ture. A second study, of Nonhern Polytechnic University 
architecture students, also found that students recalled only 
t2 percent of a lecture s content when tested almost imme- 
diately after the lecture (McLeish 19(^8). 

In general, very' little of a lecture can be recalled exce()t 
in the case of listeners \\ ith abov e-av erage edu catkin and 
intelligence (Verner and Dickinson, cited in Bonwell and 
lason 1991. p. 9). "Given the placement scores of many 
Ireshmcn. this .statement sluiuld gi\e pause to most instruc- 
tors in higher education" (p. 9). One can only imagine the 
ehecl on current students of what has become the Lectuie 
System If higher-order thinking skills “are retained and 
used long after the individual has forgotten the detailed 
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specifics of the subject matter taught in schools” (Bloom 
1984, p. 14) and if, as the old adage suggests, education is 
what remains after the facts are forgotten, what does the 
accumulated research reviewed liere imply for the quality 
of our graduates? Would it not l:>e wiser tc^ focus less on 
facts and more on developing tliese higher-order skills? 

How much of their coursework do students retain and 
how much of it can tliey use after graduation, the outcome 
that is. after all, the major purpose of the college experi- 
ence? In a study of how much students retained ot their 
two- semester introductor> economics course ct)mpared to 
otlier students who had never taken the course (vSaunders 
1980), 1,220 sophomores were given a test to determine 
their ability to c\)mprehend and use economics in realistic 
situations. As sophomores, tliose who took the introductory' 
economics course scored 18.7 percent higher than those 
who did not. immediately after ha\'ing completed the 
course, l 4.4 percent higher two years later as seniors, and 
only 9-8 percent higher as alumni, seven years after having 
taken the course. A 10 percent long-term gain in ability' 
after taking a year-long course seems slight, given the time, 
effort, and financial investment made. 

Studies regularly reported in the media suggest students 
lack basic factual knt:>w ledge most educated people belie\e 
they should have. A national Gallup sur\ey of 696 college 
senio^'^. for example, revealed 42 percent of respondents 
were unaware the Kt^ran is the sacred scripture of Islam. ^2 
percent could not locate the Civil War between 1850 and 
1900, and 31 percent placed Reconstruction after World War 
II, Only two of five items from the test for IkS. citizenship 
were correctly answered by ‘a high percentage" of .students 
(Heller 1989). The "most comprehensive survey of Ivy 
League students ever conducted" re\'cals that 50 percent ol 
3,119 .students at eight elite, highly selective institutions 
were unable to name their ow'n two IfS. senators, 23 per- 
cent did not know' the number of members on the T.vS. 
Supreme Coun, and 59 percent could not name four jus- 
tices on the Coun ( “Big Gaps" 1993: "New Poll" 1993) 

The problem of misconceptions. The diflieulty in edu 
eating our students runs deeper than the common factual 
know'ledge they should learn. Students entering a course 
often understand the plienoniena ihey .study ejuite differ- 
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enlly from the frequently more complex and abstract ways 
in which faculty experts conceive them (Gardner 1991; 

Helm and Novak 1983. Pfundt and Duit 1991)- These mis- 
conceptions arc thought to stem from students’ early 
attempts to understand a very complex world. The naive 
(or layperson’s) hypotheses they form, however, can often 
become significant obstacles to accurate understanding of 
the disciplines and effective living. Unfortunately, these 
misconceptions, often unknown to teachers, are highly 
resistant to change, especially by abstract verbal explana- 
tions in lectures, although those students who have devel- 
oped abstract reasoning skills have fewer misconceptions 
than their peers without such skills (Lawson 1988). 
Identifying misconceptions and correcting them through 
students' active exploration of phenomena with peers are 
therefore essential aspects of effective instaiction. Students 
can better confront and falsify their theories by active 
involvement than by “teachers’ simply making lecturc-st> le 
presentations (')f correct information" (Mestre 1987. p. 5) 

Taken together, tlie studies review’ed so far suggest many 
of our passive students' misconceptions — their erroneous 
ideas about the world — can slip through our educational 
net. For example, beliefs in the paranormal — astrology as a 
predictor ol personality, Bigfoot, the Loch Ness monster, 
ancient astronauts, the Bermuda triangle, ghosts, communi- 
cation with the dead, LT'Os as spacecraft — often go undis- 
turbed. suggesting the ineffectiveness of our current meth- 
ods of instruction (Bainbridge 1978; Eve and llarrold 1986; 
Teder 1986, 1987; Gray 1984, 1987; Harrold and Eve 1986. 
1987; IL dson 1987). In one comparison of the beliefs ol 
979 college students in tliree different regions (Connecticut, 
California, and *I'exas), for example, at least one-third of ihe 
respondents believed in the paranormal claim for about 
half the questions (Hudson 1987, p. 59). 

In cc^mparison, the theory' of organic e\olution, a highly 
complex, abstract, and counterintuitive concept, is the intel- 
lectual foundation for modern life science, with innumer- 
able implications for understanding the natural world and 
human beha\ ior and with many practical applications in 
medicine (disea.se). agriculture (breeding, pest control), and 
social relations (race). Today, organic evolution is one of 
the best .supported and nuvst firmly cstablisliecl tiicorics m 
the history of science. 
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How effective, then, are our current methods in correct- 
ing students’ misconceptions about this important theory? A 
survey of students at Ohio State University explored their 
attitudes toward and knowledge of evolution (Fuerst 1984). 
Of 735 undergraduates in physical anthropology and biol- 
ogy courses for majors in these fields, 75-1 percent "be- 
lieved in” the theory of evolution, but of these under- 
graduate students, only 41.9 percent both agreed that evo- 
lution was scientifically valid and understood the basis of 
this validity. Of 90 students in graduate genetics courses, 
only 55 percent responded similarly, although 84 percent 
“believed in" evolution. Another item in the surv'cy probed 
comprehension of a key — but elementary — aspect of the 
theory, differential production of offspring. Only 7.5 per- 
cent of the undergraduate students and 21 percent of the 
advanced, graduate students responded correctly. It would 
appear that “current mass biological education is not \ cry 
successful in conveying the scientific basis of evolutionary 
biology" (Fuerst 1984, p. 218). If these results in any way 
represent learning in science courses, the implications fc^r 
teachers’ effectiveness coidd be devastating. 

Oberlin College, a small, private liberal arts institution, is 
much more highly selective of its entering students than 
Ohio State, and its students are therefore on average better 
prepared than and thus significantly different in a number 
of ways from students at Ohio State. A parallel study at 
Oberlin reveals that, of 102 advanced biology majors, only 
61.2 percent understood the scientific basis for the validity 
of evolution, and a mere 16.4 percent imderst(')od the evo- 
lutionary role of differential production of offspring (Zim- 
merman 1986). 

The practical implication of such misconstruction of sci- 
ence is suggested by the further discovery that fully 17.4 
percent of the Ohio State life science undergraduates and 
1 1 percent of the life science graduate students agreed that 
teaching concepts relying on a naturalistic explanation of 
the world, such as the modern theory' of evolution, would 
lead to society’s “decay”; 8.8 percent of Oberlin students in 
the study agreed with this proposition. 

The results of the study at Ohio State “lead us to w'onder 
about the level of understanding of evolutionary biology, 
among high school teachers of biotogy" (Fuerst 1984, p. 
227), who are, of course, all educated in colleges and uni- 
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versilies. A survey of 404 teachers of biology in Ohio high 
schools using some of the items from the previous t^'o 
studies found a little over half (54 percent) of the biology 
teachers understood the basis for the validity of evolution; 
a mere 11.6 percent of respondents understood the role of 
differential reproduction (Zimmerman 19^7). For the high 
school biology teachers in the sample, “Science as proce.ss, 
as a method of better understanding the world, is not ade- 
qiuitely appreciated. Instead, science is viewed as a compi- 
lation of facts’" (p. 123). In yet another study, fewer than 2 
percent of 336 Ohio school board presidents understood 
the scientific basis for evolution, a matter with serious 
implications for effective learning of biology in the schools, 
given recent pressure to give equal time to “creation sci- 
ence" in science classes (Zimmerman 1988). Surely unclari- 
fied misconceptions and faulty understanding of concept 
in college courses are not limited to evolution or biolog\'. 
Current teaching methods in higher education could have 
wideK ranging, untoward social impacts. 

Development of higher-order cognitive abilities. Stu- 
dents develop their capacity for abstract thinking, episte- 
mology, and competence in moral judgment during the col- 
lege years (Pascarella and Terenzini 199D. Studies consis- 
fv.ruly shou', however, that growth is slow and limited. Our 
all-loo-common focus on specialized facts dispensed in lec- 
tures undoubtedly retards what might otherwise be more 
rapid and extensive development of these key cognitive 
abilities. Indeed, we might actually reinforce simple, inflexi- 
ble, concrete modes of thinking, a Dualisiic world view, 
and Conventional moral reasoning patterns. In addition, 
students’ consistent lack of vigorous intellectual interaction 
with other students or faculty could significantly limit 
development of their social, interpersonal competence. 

In life generally, as in most disciplines and professional 
fields, problem solving — the ability to solve complex, highly 
abstract, and ill-defined, ill-structured, or “messy" real-world 
problems — is essential to success. If (uir instructional meth- 
ods are often unable to help students grasp abstract con- 
cepts like organic evolutic^n. located (>n c>nly the second 
(Comprehension) level of the Taxonomy of Educational 
Objectives, what are the effects of our efforts to teach com- 
plex problem .solving? Some di.sciplines, notably the physi- 
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cal sciences, mailiemaiics, and technology, are often char- 
acterized by students’ solving many problems. How ef- 
fective is tliis common practice in developing these cru- 
cial skills? 

Although a majority of engineering students in one study 
could use memorized formulas correctly to solve physics 
“problems,” when asked for “coherent verbal descriptions” 
of the abstract concepts involved, “widespread misconcep- 
tions” suddenly appeared (Clement 1981, p. 161). A study 
of engineering undergraduates at McM aster University re- 
ports tiiat, over four years, the students watched the laculty 
solve more than 1,000 problems and they themselves 
solved another 3.000 prol-)lems as homework (Woods 
1987), “yet despite all this activity, they showed negligible 
improvement in problem-solving skills. . . ” (p. 59). Stu- 
dents were ‘excellent at recalling memorized procedures 
for solving one type of problem” (p. 58), but of the 3,000 
problems solved by students, only 20.6 percent required for 
their solution the higher-order processes of Analysis and 
Synthesis. Woods terms them “problems” rather than lower- 
level “exercises,” adding “both faculty’ and students rarely 
distinguish between these two processes.” The “problems” 
professors gave their students were, for the most part, only 
at the Application level of cognitive complexity, one step 
beyond Comprehension. Students were therefore incapable 
of developing true problem-solving skills. Fortunately, stun- 
ningly better results arc possible using methods consistent 
with research on students* learning (Van Ileuvelen 1991a, 
1991b). 

How much work do students do? Serious learning 
rec[uires students’ sustained effort outside the classroom. 
Mo.st of what effective students learn they generally learn 
outside of class meetings through reading, working on 
problems, reviewing, and other activities. An informal sur- 
vey of 20 faculty members from di\erse disciplines at 
Rutgers University and Fssex C.ounty College indicates they 
expect their students to study an average of 2.1 hours for 
every hour they spend in class. It appears, however, that 
students spend far less time studying than is necessary- for 
them to learn. 

Among undergraduates living both on and off campus at 
the University of Rhode Island, students studied about one 
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hour for eadi hour of class time; socializing was a major 
use of students’ discretionary time (Brittingham 1988). 
Fewer tlian a quailer (23 percent) of student respondents 
to another survey claimed to devote 16 or more hours por 
week to studying; employment and social activities, not 
intellectual, academically relevant activities, dominated stu- 
dents’ out-of-class time (Boyer 1990a). In a Massachusetts 
study, full-tine students claimed to study an average of six 
hours per week (Hutchings, Marchese, and Wright 1991). 
I'he 1986 Ajnerican Council on Fducation-UCLA CIRI^ study 
of a national .sample of 204,000 first-year .students reveaN 
that 50.5 percent of respondents claimed to spend five or 
tewer hours per week on “study or homework”; only 3.2 
percent spent 20 or more hours (“Hours" 1987). Only 33 7 
percent of 1993 CIRP respondents spent six or more hours 
studying, continuing a four-year decline (Cage 1994). Of 
hundreds ol Rutgers University undergraduate students in 
residence halls who conipleted 24-hour, mostly midseme.s- 
ter, weekday time reports, 60 to 70 percent reported study- 
ing only two hours a d;iy (Mollatt 1989). “About a quarter 
. . . hardly studied at all on a d;iy-to-day basis but relied on 
frenetic cramming before exams" (p. 32). These study 
habits in college seem to be continuing a pattern e.stab- 
lished earlier. I ligh school students spent a “mere four or 
fi\e hours per week" on homework (Walberg 1984, p. 22), 
as contrasted, lor example, with 28 hours on television. 

A Carnegie study reveals that (wer a quarter of under- 
graduate .students ordinarily spent no time weekly in the 
libniry^ and most undergraduates considered the librar)' 
merely a quiet place in which to study (Boyer 1987). More 
than hall did not use the library to look at specialized bil)li- 
ograpliies or follow up on works cited by writers; 40 per- 
cent did not search for additional references. In another 
national study, only 10.1 percent of first-year student 
respondents clai tiled to have studie*d in tlie library in the* 
last year (Dodge 1991). It follows that one reason for most 
student. s’ low level of use of the library could be their gen- 
erally low inve.stment of time in .studying. 

>X’itii the small amount of time most undergraduates seem 
to devote to intellectual work. v\ hat do they do with their 
often considerable di.scrctionar>’ lime? One-quarter of resi- 
dential undcrgradiKites at Rutgers Universirv’ devoted one or 
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two hours daily to “organized extracurricular aciiviiies. 
mostly to fraternities or sororities, less often to other stu- 
dent groups” (Moffatt 1989, p. 3.1). One-tenth were in- 
volved in various athletic activities, personal or intramural. 
Most of the remainder of students’ discretionary time was 
devoted to “friendly fun with peers” — hanging out, gossip- 
ing, fooling around, snacking with friends, visiting bars, 
flirting, engaging in sexual activity — and “students managed 
to find an impressive amount of time for such di\ ersions" 

(p. 33) In fact, students spent an average of over four 
hours daily on friendly fun during midsemester w'eekdays. 

A sample of 28 students attended an average of 2.5 parties 
for the previous week, tor an average of 11.5 hours in- 
vested in parties. “Class is the tediousness that the student 
body goes through between weekends” (p. 32). Fully 57 t 
percent of the 1986 ACF-UCLA CIRP respondents spent six 
or more hours weekly partying, 81.6 percent spent the 
same amount of time socializing with friends (37. 3 percent 
spent 16 or more hours), and 39.1 percent spent six or 
more hours w^atching tele\ ision (“Hours 1987). 

This low level of intellectual effort by students is \'er>' 
discouraging to faculty members (Brittingham 1988). lUit 
the apparent ease with which students are able to pass 
through American colleges and universities surely reflects 
the lectures they attend requiring only modest intellectual 
effort in class and out. A moderate level ot attention and 
skill in taking notes in class and cllort to review before 
memoiy' tests seems to ensure graduation for most. The 
influential report of the NIF' Study Group refers to students 
time as “one of our most precious educational resources 
(Study Group 198i, p. 18), but given the findings reviewetl 
here, one would be hard pressed to argue that our fact- 
dominated courses or, for that matter, our cocurricular 
activities make the best use of this time. Increasing stu- 
dents’ effort would significantly improve both students' and 
the institution's productivity. It is up to us to develop a 
psychological climate that produces students’ respcMisibility 
for high-c|uality effort (Davis and Murrell 1993). Two cen- 
turies ago, Adam Smith noted that “when the masters 
really perform their duty, there are no exampF. s, I believe, 
that the greater |Xirt of the students ever neglect theirs ” 
p. 287). 
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The bottom line: How much value do we create? 

Our students' demonstrated lack of adequate opportunity to 
practice important college-level thinking skills in their 
courses is consistent with, and might in large part explain, 
rc^sults of the New Jersey Test of General Intellectual Skills 
(CIS), an essay-lormat assessment of college-level, higher- 
order thinking skills, available as the KTS Tasks in Critical 
Winking. The GIS indicated that, among New Jersey public- 
college and university students at the end of their sopho- 
more year, only 58 percent demonstrated proficiency in 
gathering information, 4^ percent in analyzing intormation, 
33 percent in quantitative analysis, and 51 percent in pa - 
senting information (College Outcomes Kvaluation Program 
1990b). Complicating interpretation of these data, howe\er, 
is uncertainty about the degree to u hich higher education 
\^as responsible tor these outcomes and to what extent stu- 
dents' characterLstics upon entry to college or other life 
experiences during college contributed positively to the.se 
students unimpre.ssive levels of asses.sed thinking ability 

No comprehc’nsive national data on college outcomes are 
available. We have no national means of a.s.sessing and 
evaluating what students know and can do when they 
gravluate from college, or htnv effective their institutions 
have been in educating them — nor do mo.st institutions 
know . Results from the first comprehensive Natitmal Adult 
Literacy Survey, however, provide a useful, if limited, snap- 
shot of college outcomes nationwide (Barton and Lapoin'e 
1995). Ba.scd on a 1992 .sample of over 26,000 native-born 
Americans aged lo years or older, this .study reveals that 
lollege giaduates are, not surprisingly, more literate than 
people vv ho have dropped out of college or have not at 
tcncied ,it iill. Their /ere/.s' of literateness!, how'ever,] range 
Irom ;i lot less than impressive to meditxre to near alarm- 
ing, depending on who is making the judgment" (p, 2, 
t“mphasi.s in ihe original). 

I lie .Mir\ey incIuduU three seale.s — prose, cioeunient, :md 
(juaniiiaiive literacy — with each scale having five levels cU 
competence, level S being highest. Tor prose literacy, about 
hall (47 percent) of four-year college gratluates and 62 per' 
cent ol two-year graduates could not, for example, state in 
argument presented in a newspaper article or contrast the 
points of \ iew in two editorials (level ‘0; only 11 percent 
and 2 percent, respectively, could, for example, summari/e 




two ways prospective jurors can be challenged by lawyers 
or compare two approaches described in an article on 
growing up (Level 5). 

For document literacy, 53 percent of four-year graduates 
and 70 percent of two-year graduates, gi\en certain condi- 
tions, were unable, for example, to use a bus schedule to 
identify the best bus to lake, determine from a table a mul- 
tiyear pattern of oil exports (both level 4), or write a para- 
graph summarizing a table containing parents’ and teachers’ 
agreement and disagreement on an issue (level 5). For 
quantitative literacy. 47 percent of fc^ur-year college gradu- 
ates and 65 percent of two-year graduates could not, lor 
example, calculate the cost per ounce of peanut butter 
from information on a supermarket shell label (le\el or 
explain how to compute total interest charges on a loan 
from a newspaper advertisement (le\el 5). 

Again, v\ e cannot tell how much of these modest 
assessed abilities were de\eloped hy the students' colleges 
and how much they brought with them to college or de- 
veloped off cam|>us. Certainly the skills assessed by the 
National Adult Literacy Survey and even more so the (ilS 
are essential for all college graduates — and it still is some 
distance beyond to wisdom. W-e ollen claim lar more lor 
our institutions than ihe data support, and society reejuires 
far more. 

A precondition fo** improving quality in the schools 
The quality of our teaching reaches lai beyond its direc t 
ell eels on our own students. An ethnographic study of 
experienced, well-educated high school science teacliers 
reveals that ihese professionals modeled their own teaching 
behavior on their university science prof(*ssors and vviial 
they s.ivv them do as teachers (Gallaglier IVS9); lliey leacli 
as ihev were taught. These teachers did not stress logical 
organization ol content or highcr-order cognitive skills as 
import an! coiU[)onenls ol le*aching. TlK*y belie^ve*d their 
rc.sponsibdiiy was “to present information to students and 
that it is the Mudenis’ job to learn iC (p. 49). They did nol 
recognize niotivalicjn as an important part of their role 
“Many . . . vicvvledl students as predestined <p. -i9). rela- 
tively few can succeed. Nearly all of the te*achers lacked 
both concepts and v abuLiry for deep diseu.ssion about 
.suiclenis learning and about icadung Ail teachers ^mdic'd 
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TABLE 1 

NATIONAL EDUCATION GOALS 

By the year 2000: 

Coal I. All children in Amenca will stan school ready lu learn 

Ctoal 2 Tlie high school graduation rate will increase to at least 
90 percent 

Coal All students will leave grades 4 , 8 . and 12 having demon- 
strated competency over challenging subject matter, including 
lingli.sh, mathematics, science, foreign languages, civics and gov - 
ernment. economics, arts, histor>', and geography, and ever>’ 

■school in America will ensure that ali studen- .. a to use their 
miiufs well, so ihe>’ may be prepared for res[)oi .e citizeaship, 
fun her learning, and productive employment in our Nation's m >d- 
ern economy, 

Coal 4 The Nations teaching force wii! have aLce^.^ to programs 
for the continued improvement of their professional skills and the 
opponunit\ to acquire* the knowledge and skills needed to instruct 
and prepare all American students for the next century. 

Objective, The numl>er of teacliers w ith a substantive backgroimd 
in mathematics and science, including tlie metric s>stem of mcM- 
surement, will increase by 50 percent. 

Objective, The number of United States undergraduate and graduate 
students, especially women and minomies, who complete degrees 
m mathematics, science, and engineering will increa.se significantly'. 

believed they were performing well; few could identify 
ways to improve tiieir performance (see also Stark et al 
19S«. 1990). 

Today, schools and colleges in this country are increa.s- 
ingly being thought of as *‘all one system," K-16 (AAUK 
education Trust 1994; Commis.sion fcr Educational 1994; 
Ilodgkin.son 1985; Plater 1995). Each part depends on the 
others, and all must function well together if the naiion'.s 
needs are to he met. We in higher education are being 
urged to show far more interest in the schools than we 
ha\e in the pa.st and to play an active, indeed caicial, role 
in the urgent proce.ss of school reform, iniprov'ed quality*, 
and the achievement of our eiglit national goals for educa- 
tion (see table 1) (“Alliance for Learning” 1994). "The per- 
ception persists that higher education is ‘sitting on the 
sidelines* in the current .school reform effort,” however 
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Goal 5 United Stales students n ill be first in the world in matiie- 
matics and science achievement. 



Goal 6. Ever>' adult American will be literate and will possess the 
kncAvledge and skills nece.ssar>' to compete in a glolxd economy 
and exercise the rights and responsibilities of citizenship. 
Ohjec/ire. The proportion of the qualified students, espCLially 
minorities, who enter college, who complete at least two years, 
and who complete their degree programs will increase sub- 
stantially. 

Objective Ihe proportion of college graduates who demonstrate 
an advanced ability to think critically, communicate effcMively. 
and solve problems will increa.se .sub.stantiaily. 

Goal 7 Every scluioi in the United States will be free of drugs, 
violence, and the unauthorized pre.sence of firearms and alcohol 
and will offer a disciplined environment conducive to learning. 

Goals Every' scfiool will promote partnerships that will increase 
parental involvement an(.l participation in promoting the .soLial. 
emotional, and academic growth of children. 



A’ofe Tlie ohjcUive^ with these go.ils rel.Ue lu higher educ ation, ihe 

goals ha^c oiher ohiecines n()l included here 
Source National Education 

(“AAHEs New Agenda" 1993, p 10). Beyond any specific 
efforts on our part to Iielp the schools, the results of the 
studies reviewed in this monograpli suggest tluit transfor- 
mation of elementary and secondary schools will depend 
on our first significantly improving the quality of our ow n 
work as educators. 

Teachers* perceptions of the quality of their teaching 
Prc^fe.ssors rate very highly the quality of their own teach- 
ing. Nearly 90 percent of almost 1,800 faculty members at 
five types of institutions rated them.se Ives “above average" 
or “superior” (Blackburn et al. 1980). In two other studies 
cited, 99 percent of faculty rated their teaching ability 
“above average." 

What type of feedback do we receive on our professional 
work as educators? Ciiven our often-noted isolation from 
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each otiicr as colleagues and wlial is on many campuses 
and in many clepaaments a nearly [otal lack of refleclivc 
conversation about students and learning, desired out- 
comes, ancl actual results, students’ evaluations of courses 
can be a primar>' — soiielinies the only — source of feedback 
to us on the quality of our work. In contrast to some aca- 
demic folklore, howev'er. students’ evaluations of leaching 
tend tc.) be relatively mild and complimentary. In one siu»Jy 
at the Liniversiiy of Michigan, for example, students evalu- 
ated 90 percent ol the faculty as being in the upper two 
categories on the questionnaire (Blackburn et al. 1980). 
l eedback of this type can reinforce c:>ur seif- percept ion of 
relatively uniform high profe.ssional quality; “facuity don't 
believe they have any problem with their teaching” (p. 3S). 

Faculty respondents in this .study, however, were less con- 
lidcaii about the leaching abilities ol their departmental c<?l- 
leagues. rating them as lower by 10 percent (selective liberal 
aits college's) to o\'er 30 percent (re.search universities) than 
they rated themselves. (That only 31-9 percvni of respon- 
dents in a 1989 UCU survey of 35,^78 fac uity members at 
392 colleges and universities believed faculty respect each 
oihcT on their campuses could provide additional evidence/ 
of lack of communication among colleagues as well as a 
negative psychological climate unconducive to fostering 
community for staff ancl students alike [Chro}iicle 199^1) 

How do we arrive at our judgments of our abilitie.s? 

hi the main [faciilty j hose their self- rati n^^ on self-assessment 
and the performance of their students, informed student 
opinion is taken into consideration, but they value [col- 
leagues 1 feedback much less so and administrative re- 
sponse the least of all. In fact, research univeisity faculty 
es.'^ent tally find it valueless. 

In shoii, faculty apparently have a highly internal set 
(f enteha for judging their classroom performance, one 
[that] is supported by their personal experience with stu- 
dei i ts hut IS rela t / 1 *ely free f >‘orn c olleag lies' and si iper'i i - 
sols' opinions (IMdMnirn el al. 1980. p 35). 

The results of classroom tests, one of the few means of 
obtaining feedback on teachers’ work, may, with their tc*n- 
dency to focus on lads and their con mum pre^biems of 
validity and rc*liability (see ’AV'hat Ho (d;issro(mi I’ests 
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Measure?" on p. 60), seriously mislead us, and olliers, 
about the quality of our own and our institutions’ educa- 
tional performance. 

Conclusions 

On tlie basis of these studies, wliai can he said about ilic 
experiences of our students in their college courses? To 
what extent do our educational processes — th<f acti\'ities we 
choose for students — L*nhance their development in direc- 
tions we value? 

Across studies, at least about 50 percent of first-year stu- 
dents’ to seniors’ gains in abstract reasoning, critical think- 
ing, and conceptual complexity are made during a student s 
first year (Pascarella and Terenzini 1991, P- 155). Could this 
result be because of the greater intellectual rigor of college 
generally than high school, the benefit of which ditference 
is reaped early but soon le\ els off to become a low ceiling 
retarding further significant development? 

Instead of providing students with a consistent diet of 
challenging, intellectually complex situations that will help 
them develop higher- level cognitive skills and learn how 
our disciplines comprehend or construct the world, we 
instead too often give them what Joseph Schwab is said to 
have called a "rhetoric ol conclusions." We assume students 
naturally develop certain complex, higher-order thinking 
skills by memorizing facts about a discipline and then 
somehow spontaneously learn to apply these newly de\el- 
oped cognitive skills (lascher and Grant 19^3). Instead, our 
academic practices may actually retard students’ acquisition 
of facility h>r abstract thinking and their movement out of 
Dualism and Multiplicity into Relativism. Our methods may 
also limit their opportunity to confront and struggle person- 
ally with complex moral dilemmas and tc^ develop valuable 
interpersonal and team skills. 

If key misconceptions about the world pass through our 
courses undisturbed, if even the low'-level tactual content 
of our courses is relatively soon forgotten (as studies indi- 
cate most often happens), to what extent does our primary’ 
educational method, lecture-dominated courses, create 
value for our students? Without regular assessment ot cur- 
ricular outcomes, do we know? "It is nice to have taculty 
enthusiastic about updating their lecture notes and keeping 
abreast of their field, but there is not much evidence that 
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lecturing is related in important ways to [students’] learn- 
ing” (Cross 1976, p. x). 

What Do Classroom Tests Measure? 

The goals and objectives for courses provide essential guid- 
ance when we design activities in our courses and assess- 
ments to measure their results — the objectives our students 
actually achieve. These statements of inteyided outcomes 
also guide our students as they learn. It is important to s<*t 
explicit goals that describe in specific detail the results we 
intend, to use these goals actively, and to develop goals 
that are challenging rather than easy to achieve (Locke and 
Latham 1984, 1990). It is also important {a have specific 
and timely knowledge of the outccmies achieved. 

Actual results can be compared to intentions, and thus both 
students* and teachers' performance can be adjusted to 
improve the quality of results. Having studied, students 
need to know^ soon how effectively they have learned. 

Assessing studetils' intellectual skills 

because most colleges do not systematically assess the 
outcomes their curricula produce, our perceptions of stu- 
dents’ — and instil lions’ — accomplishments ordinarily 
depend on gracLs: the cumulative results of classroom 
assessment. Therefore, classroom tests become important 
for all users of grades: teachers, students, the institution as 
a whole, and higher-level policy makers. What classroom 
methods do we u.se to asse.ss students’ learning? Do our 
a.s.sessments reflect high expectations? To what extent arc 
the.se asse.ssments technically sound, and do they produce 
trustw'orthy, u.seful result.s? Do they themselves foster de\el- 
opment of high-level rea.soning skills and other important 
outcomes? 

Test item types and cognitive levels. Milton (1982) sui 
veyed the literature on classroom assessment of student 
outcomes; representative of the research he reviewed was a 
study of the types of pencil-and-paper test items employed 
by 1,700 University of Illinois faculty members. Types of 
recognition items u.sed included multiple choice (14 per- 
cent), true-fal.se (9 percent), and matching (7 percent). 
Production items requiring short written answers included 
short-answer e.ssay (24 percent) and fill in the blank (12 



percent). Only 17 percent of respondents used essay tests 
in their courses. In contrast, well-written multiple choice 
and essay items are best suited of these formats to assess 
all six levels of thinking skill in the Taxonomy of Educa- 
tional Objectives (although most faculty members write 
multiple-choice questions requiring primarily cognitive 
levels 1 and 2, recall and comprehension), Other types of 
questions assess primarily recall. Overall, therefore, the re- 
sults of this part of the study support the widely held per- 
ception that most tests college students encounter ask them 
only for kictual recognition or recall and comprehension- 
level understanding. 

Faculty respondents said they asked only 13 percent of 
“problem-solving” items, Of the 3,500 students queried in 
the study (from all classes, including juniors and seniors), 

82 percent agreed that, “despite instructors’ insistence that 
they do not teach facts, most grades are based on tests 
[that] are primarily factual in content” (p. 45). At the Uni- 
versity of Tennessee, 87 percent of about 400 graduating 
seniors also agreed with this statement (Milton 1982). Tests 
written by 19 University of Texas-Austin faculty showed 
relatively few questions requiring analysis, synthesis, or 
evaluation (Lewis 1984). 

Milton cites a study of 500 University of Illinois students, 
almost 90 percent of whom agreed with the statement, “Most 
objective examinations call for factual information" (Milton 
1982), yet another, similar study, of “two highly regarded 
very' small . . . liberal arts colleges" in the Midw^est (p. *^6), 
yielded percentages of test item ty'pes similar to those at the 
University of Illinois. These results suggest institutional size 
may not be a distinguishing variable when judging the qual- 
ity of classroom assessment. Studies of 150 University of 
Tennessee faculty teaching introductory courses and of med- 
ical school faculty produced similar results — that most col- 
lege and university classroom assessments ask students 
merely to “recall isolated facts or bits of information" (p. 49), 

Essay examinations provide faculty with opportunities to 
have students exercise not only their higher cogniti\‘e abili- 
ties but also their skill in WTitten communication. What can 
be said about the cjuality of essay tests?" Of 4,500 students at 
five Nebraska institutions of various types, including the state 
research university, almost half of the students (47 percent) 
claimed never or only rarely e\x*r to have had tf) write an 
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essay examination (Milton 1982). At the University of Illinois, 
17 percent of faculty respondents claimed to use essay tests, 
hut of four factors professors used to evaluate tiie quality of 
essays — oi^ganization, style, knowledge of facts, and origina- 
lity — faculty' from most depanments considered knowledge 
of facts the most significant indicant of quality in students’ 
essay responses. The inference is that most of the essay 
questions written by these faculty members prolxibly re- 
quested isolated facts. 

Students tend to prefer multiple-choice te.sts to essay 
tests, which might be because essay tests are rare, even in 
small colleges (Milton, Pollio, and Eison 1986, p. 167). This 
“preference reflects a common belief that (multiple-choice! 
te.sts are easier to take and to get good grades on*’ (p. 172), 
a belief consistent with the apparently low level of cogni- 
tive skill demanded for most multiple-choice items used by 
most professors. 

Publishers’ test-itein banks. A further contributor to tlie low 
cognitive lev el required by many classroom tests may be the 
test-item banks in lxx)k or computer disk fomxit textlxx)k 
publishers supply free to professors. Tliese gifts are induce- 
ments to profe.s.sors to require their students to purchase the 
publishers lxx>ks. U.sing the items in the.se collections individ- 
ually or having them automatically compiled into a test directly 
from the disk can save teachers coasiderable time, A rating of 
tile quality, on .sevenil dimensions, of sLx randomly .selected 
psychology' textlxxik test-item banks, hovwv'er, found common 
defects in design of the items (Evans, Dodson, and bailey 
1981). In addition, a rating of 276 items by two independent 
raters using the 7axonomy of Kdueational Qbjecti\x^s (vvitii the 
raters in agreement 98 percent of tiie time) revealed tliat 83.3 
percent of the items in one bank rec|uircxl recall only, in three 
hanks the range was from 94.1 to 96.4 pert'ent recall, and two 
banks recjuired memory' for UK) pc*rcent of their items. Only 10 
Items, or 2.8 percent of the total .sample, were even at level 2, 
c()mprc‘hension. And o;//v r);?eof the 276 items studied asked 
lor any higher-order thinking, analysis. Concluding lies exten- 
.sive review of rc».sc‘arch on cia.s,sr(xjm tests, Milton (1982) notes. 
**Mo.st te.st que.stions for undergraduates and for some ad- 
vanced students require a gra.sp of factual iiifomution and little 
more, niere is almost no emphasis Ithroiighj lest que.stioas on 
the higher-order menial pnxesses*' (p. ‘i9). 
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The technical qualities of classroom tests 

Among the characteristics used to judge the quality of 
assessment methods are their capacity to produce valid 
inferences when interpreted and their reliability. For exam- 
ple. a pencil-and-papcr test that assesses what it is said to 
assess, and not something el.se, is able to produce evidence 
that can form the basis for valid interpretation. A lest that 
assesses something oilier than what it is thought to assess 
produces results useless for decision making. Reliability is 
an assessment s stability or consistency of performance 
ov'er time. For example, a test administered to different 
groups of people at different limes, if reliable, tends to per- 
form similarly during each administration. Because reliabil- 
ity' of the instalment is a prerequisite for validity, a test that 
is unreliable also produces untrustworthy results. 

Validity of classroom tests. At the I'niversity of Kansas, 

17 faculty members in art and science disciplines indicated 
that 31 percent of their test items assessed “complex cogni- 
tive skills (such as problem solving) in their students” 
(Milton, Pollio, and luson 1986, p. 21) Independent judges, 
however, found only 8.5 percent of the item.s were of this 
sort; 91 percent of the items asked for recall or recognition. 
In other words the validity of any inferences the teachers 
may have made about their students complex cognitiv'e 
skills based on these tests was compromised by the assess- 
ments’ inability to measure the behaviors claimed. 

Reliability of classroom tests. A 195-4 study of 1,000 fac- 
ulty members in 28 colleges and universities concluded that 
little evidence existed of the teachers' delilx^rate ef foils to 
design reliable tests (Milton 1982). Another study, of almost 
200 classrtx>m tests from diverse disciplines at Pennsylvania 
State University, found that after statistical analysis, "the reli;i- 
bilities were found, on the average, to be very Uw” (p. 26). 

Experience in colleges and universities and the many 
published studies consi.stenily suggest that faculty in this 
country care deeply about their students' developing higher- 
order cognitive skills. It is equally clear from the studies 
reviewed here that our tests do not generally assess such 
skills. Our tests are thus in all too many cases unable to 
produce evidence relevant to our students' reasoning. Ap- 
parently, many c^f the professors in the studies described 
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here Vk'ere unaware the technical properties of their 
assessments, w'hich is not surprising, given that few of us 
have had the benefit of formal training for our work as 
teachers. For example, most faculty members in colleges 
and universities today are still unaware of the Taxonomy of 
hducational Objectives, for four decades the standard for 
controlling the cognitive demands of assessments. “Good 
teaching also means careful evaluation of the student. And 
yet it is for this important task most teachers are not well 
prepared" (Boyer 1987, p. 154). 

Laying a firm foundation. The l:>asis for planning effective 
assessments in courses is a set of explicit, written objecti\es 
that state the course's intended outcomes for its students’ 
development in specific and behavioral language (GardiniT 
1989). hach of^jective determines, among other things, the 
cognitive level at which students should be able to perform. 
But most college and universiry faculty' members still do not 
de\ elop formal instructional objectives for their courses. 
Consequently, their assessments frequently lack the solid 
foundation of clearly stated outcomes required for effectix e 
design. “If the teacher’s thinking is not too clear about aims, 
there is no way that test que.stions can be prepared [that] 
will measure them" (Milton 1982, p. 25). 

A comparison with commercial tests. With the remark- 
able increase of interest in assessment of all types in higher 
education over the last decade, certain vxidely used com- 
mercial tests have come under intense criticism. Concerns 
have been voiced about the capacity of the.se instruments 
to measure the complex kinds of learning in which our siu> 
dents engage and their alleged potential for producing 
biased results '^^hen taken by members of ethnic and cul- 
tural minority groups. Such instruments, liowever, are usu- 
ally constructed with the greatest of care by some of the 
nation’s most highly trained experts in assessment (Milton 
1982). Each item is laburic^usly pilot tested, subjected to rig- 
orous criticism, and revised, often several times, before use. 
These same concerns about commercial instruments have 
not generally been raised about college classroom tests, 
however, which are, through grades, usually the main form 
of evidence of both students’ development and iastitution.s* 
performance. American students take a vastly greater num- 
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ber of these faculty-designed tests each year than they ever 
do of commercial tests. “Classroom tests continue to reign 
supreme; it is as though tliey are error free" (Milton 1982, 
p. 4), Perhaps it is tliese tests that “slioulcl be tlie primary- 
targets of criticism” (p. 4). 

Conclusions 

Very- few of us have had formal training for the complex 
task of designing and interpreting assessments of students' 
work. Instead, our training in graduate school has generally 
been almost exclusively as researchers, as discov'erers of 
knowledge in some relatively narrow, specialized area of a 
discipline. A study of graduate teaching assistants at the 
University of Tennessee— Knoxville, replicated at other insti- 
tutions, showed that 91 percent of these students prepared, 
and 99 percent evaluated, tests and that 91 percent as- 
signed final grades (Milton, Pollio, and Eison 1986). The 
training and guidance these st<.ident-teachers received for 
this complex, technically demanding psychometric work 
with high impact on students was “minimal or nonexistent " 
(p. 12), Almost three-quarters of University of Tennessee 
faculty members in one study claimed to have learned henv 
to design tests without any formal training (Milton 1982), 
and over a quarter of the respondents claimed that intuition 
was responsible for any skill they had in developing tests. 

In another study, 82 percent of professors cited trial and 
error as their method of learning test design (Milton 1982). 

Considerable literature exists that can help teachers 
design high-quality assessments of student learning (Angekj 
and Cross 1993; BU^om, Hastings, and Madaus 1971; Carey 
1988; Cashin 1987; Clegg and Ca.shin 1986; Cronbach 198-4; 
Hanna and Cashin 1987; Jacobs and Chase 1992; Mehrens 
and Lehmann 1984; 'fhorndike and Hagen 1986). But col- 
lege faculty members do not generally read the profes.sional 
literature in higher education. “Around 99 percent of faculty 
members do not read either the past or ihe current litera- 
ture from which these investigati(jns have ’*ven drawn " 
(Milton 1982, p. 33). The problems of validity and reliability 
de.scribed above can in large part be atirilnited to our lack 
of kmwledge of how to as.sess our students' learning. 

Given such a foundation of sand as an underpinning for 
classroom a.ssessment and grading, Milton asks, “NX’hal is 
the meaning of a GPA?” (p. 51). 
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To what extent do our attempts to assess actual outcomes 
affect the achievement of intended outcomes? The Uncer- 
taint>' Principle, well known in the field of physics, states 
that the process of measuring a phenomenon will itself 
affect the phenomenon (Milton 19H2). The Unceitainty 
Principle thus suggests that our attempts to assess students’ 
developmental outcomes may affect the learning process 
itself. Students generally study what they believe will be f)n 
tests, as their grades and futures are at stake, Emphasizing 
tacts on tests communicates to students that the Expert- 
Authority, the teacher, believ'es learning factual knowledge" 
is what is most imponant. Thus, students emphasize the 
memorization of facts, most ol which they w'ill soon forget, 
and may thus be kept from using their learning experieme 
to develop more sophisticated and imponant abstract rea- 
soning skills and critical or creative competencies. Studenis 
are likely thus to be sjxxifically retarded in their cognitive 
development and retained in place where* they now are. 

The many who are Dualists, lor example, may not only not 
be assLsted in their needed move to Multiplicity, but al.so he 
actively reinforced in Dualism. The specific message they’ 
may receive in our courses is that facts are what count; get 
them pa.ssively from Authorities. 

Overall, the low- cognitive-level content of our classroom 
a.sscssments and our lack of attention to questions of valid- 
ity and reliability' call into question the meaning of the* 
results generally produced by the,se tests, as well as the 
manifold uses of these result.s by students, teachers, institu- 
tions, and policy makers. 

What Do Grades Tell Us? Do Grades Affect Outcomes? 

Grades are the chief means by which faculty in most U.S. 
colleges and universities signify' to students and others, 
inside and beyond the institution, the quality of our devel- 
opmental outcomes. A national sample of 6,165 students, 
parents, business recruiters, and faculty' members discov’- 
ered that most people place considerable faith in the 
capacity of grades to communicate effectively important 
characteristics of students (Milton. Pollio, and Eison 198(J. 

How well do grades communicate outcomes? 

Cirades are related to cognitive development and acadefuic 
learning (A.stin 1993; Hartnett and Schroder 1987; .Smith 
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1992), but their meaning is often unclear and their interpre- 
tation difficult. 

Research on grades extends Ixick to at least the early 
years of this centur>^ (see. e.g., Starch and Elliott 1912, 

1913a, 1913 b), and a number of their serious conceptual 
and statistical weaknesses as means of communication have 
long been understood. More recently, grades have come 
under intense attack as being ineffectual in doing the work 
we ask of them as well as for actively retarding our efforts 
as educators (Hattersby 1973; Kirschenbaum, Simon, and 
Napier 1971; Kohn 1993; Marshall 1968). 

First, as single letters ov digits, grades can scarcely com- 
municate detailed, useful inh)rmation about achievement ot 
the diverse cognitive, affective, or motor t)utccjmes we 
seek. Second, given the uncertain effectiveness as mental 
measurements of most classroom tests, the wide mixture ot 
tests, class participation, attendance, and other ccanponents 
of grades, and the fact that the user of a grade rarely has 
any idea which of these variables went into a grade or in 
what proportion, the utility of grades as means of commu- 
nication is deeply compromised. A grade is 'an inadequate 
report of an inaccurate judgment by a biased and variable 
judge of the extent to which a student has attained an 
undefined level of mastery of an unknown proportion of 
an indefinite amount of material” (Dressell 1957, p. 6). 

Third, the preeminent use of grades is not to give feed- 
back to students on their development, but to provide a 
basis for those outside our institutions to sort, rank, and 
select those of our graduates whom they deem fit for their 
own purposes (Milton. Pollio, and Eison 1986). Employers 
and graduate schools rely on grades as impc'rtant predictors 
of future success; thus, grades form a basis for high-.stakes 
decisions about a student. Ironically, the predictive validity 
of grades is severely limited. Major reviews ot 108 (Cohen 
1984) and 150 (Baird 1985) different studies of the relation- 
ship betw'een college grades and diverse types of adult 
achievement revealed it in be slight. Undergraduate grades 
do predict first-year graduate c^r prc^lessional school grades, 
their strongest predictive ability, but only at a median level 
of about O. 3 O; in fact, assuming the nc^rmal distribution ot 
grades, only 60 percent of students will even liave their 
graduate school grades in the same half of the distribution 
as their undergraduate grades (Warren 1971). 
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Rather than helping students develop, we may be gencr- 
aiing grades for a professionally questionable weeding-out 
function for someone else’s convenience by means of a sta- 
tistically compromised method — and in so doing labeling 
many of our students “damaged goods." A high-qualir>’ 
educational process uses assessment formatively to ensure 
all “products" are ot high quality' and communicates results 
continuously to students in meaningful ways. The needs of 
(Mher organizations too often take precedence over our 
educational responsibilities to our students. 

Do grades affect moral development? 

Faculty are often unhappy with students’ frequently single- 
minded focus on grades rather than their own intellectual, 
affective, and social development. This orientation toward 
grades, presumably fostered by the high stakes associated 
with them, may have wider implications for students' de\ el- 
opment than distraction from significance and effort wasted 
on the irrelevant. Research suggests the emphasis on pro- 
ductiem of grades may create a psychological climate that 
retards rather than enhances students' moral dev'elopment, 
a linchpin of mature human relations and prosocial beha'.'- 
ior throughout life. 

How much do students cheat? Fully 70 percent of faculty 
respondents in one survey agreed that undergraduates 
“have become more grade conscious." 42 percent agreed 
that undergraduate students “are more competitive,” and -43 
percent believe students are “more willing to cheat" (Hover 
1989). Grades provide for many students a rationale to 
engage in unethical behavior based on low-level, precon- 
vcntional moral reasoning. When asked whether they had 
ever cheated to get a better grade, one-third of a national 
sample of 6,155 students and former students responded 
affirmatively (Milton. Pollio, and Eison 1986). Over half of 
current students in the sample said they had cheated. In a 
1964 study, one-half of the students reported they had 
engaged in academic dishonesty, including over one-third 
of the respondents with A's and B+ s (Milton, Pollio, and 
FJson 1986). These findings are consistent with an estimate 
of a 40 to nearly 90 percent rate of cheating cited by Bo* er 
( 1990a) and considerable additional research. 
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Two-thirds of 117 Rutgers University students in one 
study claimed they had cheated in their courses, 95 percent 
of them more than once (Norman 1988). In another study 
at Rutgers, the researcher classified fully 50 percent of eco- 
nomics majors and 42 percent of communications, political 
science, and psychology majors as “hard core” cheaters 
(Moffatt 1990). Another study of 3,630 college students 
found that, during the previous year, 32 percent had cheated 
on an examination, 61 percent had lied to their parents, 16 
percent had stolen items from a store, a^d about a third 
would lie to secure a job on their resume, on the applica- 
tion, or during an interview (Viadero 1992). 

Other studies abound. Of over 6,000 students at 31 “highly 
seltx'tive” colleges, two-thirds of respondents claimed to 
have cheated on a test or major assignment at least one 
time w^hen in college; one-fifth (19.1 percent) were “active 
cheaters,” cheating five or more limes (McCabe 1992). Over 
half (52.4 percent) of cheaters cited pressure to get good 
grades as a significant motivation behind their dishonest 
behavior. 

Forty’ percent of 552 Concordia University students 
claimed to have cheated “in recent months"; 60 percent of 
engineering and computer science majors had cheated in 
the six months before the study (“Widespread Cheating" 
1987, p. 47). A study of 234 first-year through senior stu- 
dents in introductory’ courses at Miami University of Ohio 
found that 72.1 percent of respondents claimed to have 
plagiarized class work. Based on an analysis of additional 
items in the questionnaire, other students, presumably 
unconsciously becau,se of ignorance, w'ere likely also pla- 
giarizing, making a total of 91.2 percent who plagiarized 
(“Plagiarism" 1990). In another study, over 30 percent of 
the 200.000 student respondents had plagiarized in the pre- 
vious /ear Thi.s behavwjr is consi.sient with research on the 
moral development of college students, "Perceptional 
some moral issues [isl distressingly low," and ‘.students gen- 
erally [show’l insensitivity to the is,sue of promi.se keeping" 
(McNeel 1994, p. 46, emphasis a<ided). Students* reasons 
for cheating ciem()nstrate a variety of probable lower stages 
of moral judgment. Wc need to help students recognize 
ethical dilemmas and how to think effectively about them. 

How effectively have we dealt with this apparent epi- 
demic <if antisocial Ix’havior^ Too often. 1 tie inloimalion is 
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av'a liable to students or faculty about an institution s policy 
on dishonesty’, resulting in confusion (Maramark and Maline 
1993). Students “rarely report" others’ dishonesty (p. 5), and 
as few as 20 percent of faculty' who obseived cheating com- 
plied with their institution’s policies for handling it. 

Does cheating have long-term developmental effects? 

A meta-analysis of 521 studies on cooperative versus com- 
petitive and individual beliavior cites various sources indi- 
cating the Lintow'ard ellects of grade-induced competition 
(Jolinson and Jolinson 1989). In an effort to gain admission 
to medical school, students quoted in the Chicago Thbinie 
claimed to “try to give the wrong information to other stu- 
dents, We take books from the medical library and destroy 
parts of them. We don’t share information. We sabotage 
others* chemistry experiments" (Johnson and Johnson 1989, 
p, 32). The university at the undergraduate level sounds 
like a place w^here cheating comes almost as naturally as 
breathing, w here it s an academic skill almost as important 
as reading, writing, and math" (Moffatt 1989, p. 1). Indeed, 
this valued skill has justified at least two book-length trea- 
tises on its methodological subtleties (Baker 1989; M. 

Moore 1991 ). What is the intellectual and ethical quality of 
such a campus climate? And wdiat, then, does a grade mean? 

hntirely aside from the potential corrupting effects of 
cheating on the validity' of a student’s grade point av'erage, 
what may be the long-term effects of a panern of dishon- 
esty' consistently unchallenged in college? The president of 
the Association of American Medical Colleges stated in a 
speech to the association that cheating by premed students 
is “all too common’’ (“Does Research" 1988). Citing the 
association s investigation of 952 cases of dishonesty’ over 
the prev'ious decade, he .stated that dishonesty' is repeated 
later in undergraduate and graduate medical training 
through residents’ stealing supplies and possibly in re.search 
fraud and called for medical school admission committee's 
to look at the “moral background ” of applicants. 

A state investigation discovered that, among partners in 
mcj^tly New ^'ork City law firms, who are noi required to 
pay withholding tax. almost 10 percent failed to file stale 
income taxes for one or more of the pre\ ious three years, a 
rate about 20 times greater than the 0.5 percent rate for 
their employcc.s, who do have to pay w'ithholding taxes 
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(Kolbcit 1989). Nearly 350 of these partners had failed to 
submit tax returns for three or more years, a felony for 
which conviction leads to automatic disbarment. Recall the 
relatively low moral judgment scores discovered among 
senior members of CPA firms (p. 29). I'hese highly placed 
professionals are graduates of our institutions, many of the 
institutions prestigious and many of the professionals with 
both undergraduate and graduate degrees. What role did 
we play in their moral development? One study found that 
one-third of a sample of 39 college teachers had an aver- 
age principled reasoning score "scarcely above that typical 
of incoming freshmen” (McNeel 199^1. p -12). 

The media regularly describe yet other species of corrup- 
tion among highly placed persons in business and govern- 
ment almost all of them graduates of our institutions. They 
also frequently publish reports of scandals on campus iissa- 
cialed with finances, research fraud, drugs, sexual \ iolence, 
and athletics. Aside from the climate of moral laxity such 
events can engender, what will be the life-long conse- 
quences of the moral classroom climate we. members (jt 
the most highly educated sector of society, create through 
our toleration of widespread dishonesty during these for- 
mative years? 

Speaking broadly of our responsibility for students’ moral 
development, former Harvard president Derek l^ok stated, 
“Despite the importance of moral development to the indi- 
vidual student and the sneieU', one canntn say that higher 
education has demonstrated deep concern for the problem ’ 
(cited in Gold 1988). Frecjiiently. "especMlly in large univer 
sities, the subject is not treated as a serious responsibility 
worthy ^)f sustained tliscussion and determiiied action by 
the fat uity and administration.” Research on campus cheat 
ing seems ct^nsistent with this view, 

Coficlusious 

Considering the widespread practice of sumnialive. (hjcci- 
dcteciing. lor-grading-only assessmenl. the amount i>t re- 
sources in student, faculty, and administrative staff time 
and energy' devoted to ['inKlucing, camimunicating, and 
curating grades is enormcuis. Instead of focusing on bu- 
reaucratic number crunching. suppf)se we focused instead 
on personally meaningful learning aimed at specific, staled 
outcomes and assessed students regularly lt» provide' form.i- 
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live feedback on their progress — defect prevention. Should 
we not be focusing on our students’ development, includ- 
ing their moral development? And what would be the effect 
if we taught students how to recognize, reason skillfully 
about, and avoid unethical behavior? 




O 



THE CAMPUS CLIMATE; Context for Development 



The quality of the psychological climate on campus can be 
a caicial factor in aiding or limiting a student’s develop- 
ment. The extent to which our now-diverse students find a 
welcoming, intellectually stimulating, ethically principled, 
and emotionally supportive and caring environment when 
they arrive on campus can significantly affect both their 
decision to remain in school and their achievement of the 
desired developmental outcomes. Today, we understand 
better than ever the key roles played by social relation- 
ships, sense of community, and emotional support in effec- 
tive learning. Lack of a sense of community among stu- 
dents had more powerful direct effects on their satisfaction 
with their college experience than many other of 192 envi- 
ronmental variables in Astin’s major study (1993). With 
care, we can transform a potentially stressful transition to a 
new community — with its strange customs, more demand- 
ing tasks, and personal risks — into sustained, high-quality 
effort leading to personal and professional fulfillment, and 
we can do so by developing in each person an inspiring 
vision of his or her capacity for high-quality performance 
and potential impact on society. 

Climate and Student Development 

Research on student outcomes demonstrates a clear associa- 
tion between psychological climate and students' academic 
performance, intellectual and personal growth, attitudes 
toward their academic programs, satisfaction with college, 
and voluntary persistence on c'ampus (Pascarella and Teren- 
zini 1991). Contact with other students and staff is key. “It 
is clear that many of the most important effects of college 
occur through students' interpersonal experiences with 
faculty members and other students" Cp. 644). Students’ 
experiences in the classroom are an important factor. The 
climate in the classroom, or “psychological morale’’ (Wal- 
berg 1984), has a strong effv^ct, not only on cognitive but 
also on affective learning, increasing it by a full .60 stan- 
dard deviation. 

A pervasive interest in the world, an excitement with 
ideas, and an eagerness to learn can inspire new members 
of a campus community to high-quality intellectual effort. 
Many of our campuses, however, apparently fall short of 
this ideal, with instruction and assessment in many c: most 
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classrooms focusing on memorization of facts, grades domi- 
nating intellectual life on many campuses, and a climate 
that often tolerates widespread cheating. 

Funher, results of several major studies indicate “alcohol 
tihuse is a common, not marginal, activity at most colleges" 
(Wechsler, Deutsch, and Dowdall 1995, p. Bl). Eighty per- 
cent of fraternity and sorority residents binge. Of 17,592 
students on 140 campuses in one study, representative of 
ali four-year institutions, 44 percent of respondents reported 
binging at least once in the previous two weeks (Shea 
1994). At in.stitutions where half or more of students were 
binge drinkers, more than half of first-year students said 
they had binged in their first week on campus, two-thirds 
during the first .semester (Gose 1995). Legal drinking age 
presents no ob.stacle to obtaining tilcohol, and underage- 
drinking is pervasive. 

Drunkenness commonly leads to a campus climate char- 
acterized by vandalism, verbal and physical violence, un- 
planned, unwanted, and unsafe sex, disturbance of others' 
.studying tint! sleep (87 percent of nonbingers in one study 
[Wechsler, Deutsch, and Dowdall 19951), and relatively low 
academic achievement for bingers. Tolerance of this pattern 
ot behavior creates a campus climate antithetical to intellec- 
tual work, civility, community, and human development. 

•Some colleges now experience violence from the pres- 
ence of gangs, guns, and drugs on catnpus (Lederman 
1994). Fully 7.5 percent of 29.935 .student respondents in 
one .study said they had carried guns, knives, or other 
weapons in the previous 30 days iChrunicle 1995b). MIT 
and Louisiana State now use walk-through metal detectors 
to .screen out guns and kni\ es at large parties given by stu- 
dent groups {Chronick- 1995a, 1995c). 

Integration into the Community and Involvement 

According to Vincent Tinto, integratiem is "the perception 
of being a member, of belonging to an institution where 
people value your pre.sence" (Evangelauf 1990, p. A 18), 

And what develops a community that integrates every per- 
•son is a “high-quality, caring, and concerned faculty and 
staff (Tinto 1993. P- 201). Students' academic and social 
integration affect.s po.sltively their persistence on campus 
(Bean 1980; Cabrera et at 1992; Cabrera, Nora, and C.ist,i- 
Peda 1993: Tintf) 1985. 199.3). 
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Of college and university presidents surv’eyed by the 
Carnegie Foundation (Boyer 1990a), 97 percent “strongly 
believeldl in the importance of community,” and 71 percent 
of respondents (87 percent at research and doctoral univer- 
sities) rated as “very important” the need for a greater effort 
to build a stronger overall sense of community on their 
campuses. In the 1989 Carnegie surv'ey of faculty, 11 per- 
cent of respondents rated the quality of life at their institu- 
tions as "excellent,” 50 percent as “fair or poor” (Boyer 
1989). Only 9 percent of respondents said an "excellent” 
sense of community’ could be found on their campuses; 28 
percent rated community as “good,” 66 percent as “poor,” 
Students feel the lack of community as well. About half of 
the students who responded to a 1984 Carnegie Foundation 
sur\'ey .said they felt "like a number in a book," and about 
40 percent claimed not to have any professor w'ho was 
“interested in their personal lives” (Boyer 1989). 

Research and obser\'ation bear out this sense of alien- 
ation. “At present our colleges do not on the whole ever 
take account of their students as persons, not even the col- 
leges that claim to be .small and personal” (Bowen 1980, p. 
34). The “most notable decline during the college years'* 
has been in students’ sense of psychological well-being 
(A.stin 1993, p. 397). Might this effect f>e related to the 
degree of support a student feels? 

According to one study, a majority of 406 medical stu- 
dents at two different institutions claimed to have been sub- 
jected to physical or emotional abuse during their four 
years in medical school (Nicklin 1990). Abuse involved in- 
.sult.s, aide ness, physical blows, and threats of bodily harm, 
and, for over half the \vi>men at one institution, .sexual 
ad\ances, in most cases from physicians and clinical staff. 

The results of our neglect of students' emtaional and 
social needs may be profound. Of 189 undeigraduates at 
the University of Waterloo (Ontario), almost half claimed 
to have considered committing suicide during their stay at 
the university, 39 percent because of stress (“Half" 1985). 
Finding the campus “one of the more stressed environ- 
ments in society,” the researchers note that Canadian col- 
lege and university students commit suicide at a rate 50 
percent higher than non.students of the same age. Although 
the rate of suicides among college and university students 
in the United Statc.s is lower, after accidents suicide is ne\ er- 
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iheless estimated to be the second cause of death for col- 
lege Students (Shea 1995). 



Commuter and Part-time Students 

Considerable evidence demonstrates that residing on cam- 
pus confers on students considerable benefits compared to 
students who commute from off-campus housing (Chick- 
ering 1974; Fascarella and Terenzini 1991). "The most im- 
portant determinant of college impact is living on campus, 
an experience that opens students to other forces for 
change" (Gamson 1991, p. 52). Yet most students live off 
campus. The prominence of commuter students on campus 
has changed dramatically over the last 30 years, partly as a 
result of the development of community colleges, virtually 
all of whose students commute. Today, about 80 percent of 
U.S. undergraduates commute from housing beyond their 
campus borders (Jacoby 1989; Stewart and Rue 1983). How 
responsive are we to the special needs of this large group 
of students? Sixty percent of college presidents at four-year 
institutions who responded to one survey reported inadc*- 
quate — low-quality — ser\4ces for commuters on their cam- 
puses (Boyer 1990a). Seventy-six percent of presidents 
staled students’ lack of participation in campus events was 
one of the most serious problems affecting student life. 

How do we respond to the needs of the almost one-half 
of our students who attend college part time? Many of them 
are older adults who hold full-time obs in addition to rais- 
ing families and therefore live off-campus. Despite the spe- 
cial needs that must be met if they are to have educational 
experiences in any way comparable to those of full-time 
students, ail of us in academe know well the casual atten- 
tion these students often receive. "The best universities 
especially continue to abhor part-time students, and some 
are almost cruel toward them" (Keller 1983, p. 14). We 
must be more careful to meet these students’ needs. 



Students* Involvement with Faculty 

Large, impersonal lecture courses, ineffective responses to 
commuters’ needs, and other deficiencies in climate can 
conspire to reduce students’ crucial out-of-class contact 
with -Other students and the faculty, widening the gulf 
between them. At Rutgers University, for example, students 
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. . . had no idea of most of what the professors spent their 
time doing and thinking about: research, publication, 
and departmental politics. . . . Student friends were sur- 
prised to learn that / had written a book, or even that I 
had my Ph.D. Two . . . admitted . . . that they had always 
privately thought that *' tenure'' meant a faculty member 
had been around for '‘ten years" 1989, p. 25). 

“Many faculty and academic administrators distance them- 
selves from student life and appear to be confused about 
their obligations in nonacademic matters” (Boyer 1987, p. 

5). A lack of faculty members’ engagement with students of 
this magnitude mightily limits the positive developmental 
effects w'e can and should have. 

The Climate for Women and Members 
Of Minority Groups 

Of special importance to us should be the campus climate 
perceived by women and students from minority groups. 
Beyond our ethical responsibility' to ensure a hospitable, 
nurturing environment for all our students, the success of 
these two student populations is especially important in a 
number of different fields crucial to the nation’s future, 
given the urgent state and national need to graduate thent 
in far greater numbers and in more diverse fields than we 
now do. The success of w'omen and members of minority 
groups in college has become an urgent societal priority. 
Tc^gether these groups make up well over 50 percent of all 
students on most campuses, and research on the campus 
experiences of women and members of ethnic minorities 
can illuminate the quality of the campus climate for every- 
one. The capacity of the campus climate to inspire and 
sustain these students and to provide the essential personal 
validation they often require (Rendon 1994) can be a pow- 
erful tool for ensuring their retention and success in college. 

Women on campus 

In the decade from 1974 to 1984, the number of women 
in college increased nine times faster than the number of 
men (Bernstein 1990). In 1980, women for the first time 
made up fully half of all college undergraduates, finally 
achieving a level of attendance cc|ual to that of men, 
although this proportional increase has primarily benefited 
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white women rather than women of color (Bernstein and 
Cock 1994). During approximately this same period of 
rapid growth, from I960 to 1986, however, women’s cc;l- 
leges, whose historic contributions to the education of 
and provision of opportunities for women are well docu- 
mented (Astin 1993; Pascarella and Terenzini 199D, de 
creased from 233 to 90 (Bernstein 1990). Women’s col- 
leges, as perceived by their students, tend to be more 
student-centered and civic-minded than coed institutions 
and to value multiculturalism more (Smith, Wolf, and Mor- 
ri.son 1995, p. 264). They involve their students more 
deeply and thus are more effective in producing several 
important outcomes among students. In fact, after remov- 
ing the effects of college selectivity and individual factors, 
“graduates of women’s colleges are strongly overrepre- 
sented in the high-status, male-dominated occupations of 
medicine, scientific research, and engineering” (Pascarella 
and Ter-enzini 1991, p. 601). 

Now that their access to higher education has impro\ ed, 
what is the quality of the campus experience for women? 
Regrettably, the \\^ays in which women and men are treated 
still differ significantly on many campuses (Hall and Sandler 
1982), a continuation of a pattern established earlier, in ele- 
mentary* and high school (Rothman 1991). Women are still 
subject to a “chilly" climate in the classroom (Hall and 
Sandler 1982). 

Studies demonstrate a consistent pattern of behavior tiuit 
must surely significantly affect the development of our 
female students. For example, fenrde students are called on 
in class less often than males and when called on are nn-re 
often than men asked low. Recall -level cjuestions; men 
receive more complex questions requiring higher-order 
thinking (Sandler 1986). Women students receive less 
encouragement than men; for instance, they are more often 
interrupted during discussions and receive less eye contact 
th;m men when a teacher asks a question (discouraging a 
resi^onse). Women’s names are forgotten more often than 
men’s, they are chosen less frec|uently as faculty assistants, 
and, despite the urgent need for women in the natural sci- 
ences and technology', their advisers sometimes openly dis- 
courage them from choosing traditicmally “masculine" 
majors like mathematics, physical science, and engineering. 
Iliis ( hilly climate extends to female graduate students, 



faculty members, and administrators as well (Flam 1991; "Mich- 
igan State” 1995). 

These subtle and in many cases unconscious behaviors 
on the part of students, faculty, and administrators can, 
with time, become fused to form for women students a 
consistent, pervasive climate of devaluation, discourage- 
ment, and lowered expectations, in class and elsewhere on 
campus (Hall and Sandler 1984). Added to apparently per- 
vasive, although often almost imperceptible, slights by cam- 
pus authorities are all-too-frequeni direct assaults on 
women’s self-esteem. Comments that openly disparage 
women, their efforts, and their accomplishments; overt sex- 
ual harassment by facult>’, administrators, or peers (Dziech 
and Weiner 1984; Hughes and Sandler 1986, 1988); and dis- 
crimination against women in the choice ol faculty assis- 
tants, awards for undergraduate and graduate students, and 
promotion and tenure for faculty members have been doc- 
umented at loo many institutions. Added to these problems 
for women is overt sexual violence in the form of date or 
acquaintance rape (Hughes and Saujler 1987) and party or 
gang rape (Ehrhart and S.mdler 1985), both apparently 
more prevalent on campus than commonly believed. Such 
actions further compromise our environment as a nurturing, 
developmental one, certainly for women, but also for men. 

Although the climate may imyfrom institution to institu- 
tion, the hidden or not-so-hidden message ii'omen too 
often receive from faculty, staff and fellow students is that 
they are not on the same level as their male peers and are 
"outsiders" on campus {H’dW and Sandier 1984, pp. 3^). 

Sexist attitudes persist on campus (Boyer 1990a). In one 
study, 40 percent of undergraduate women respondents 
indicated they had been sexually harassed on campus, and 
at Harvard, 34 percent of undergraduate women reported 
harassment from an institutional authority (Boyer 1990a). 
“Most shocking are the physical assaults against women, 
which were reported on nearly a third of the campuses . . . 
visited" (p. 34). At one university, 20 percent of the women 
studied said they had had “unwanted .sexual intercourse." 

Given what i.s often a clearly nonsupportive campus cli- 
mate hir women, many women cumc to devalue and doubt 
(heir own abilities .iml to reduce their expectations for their 
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careers and lives. NXliile the most obvious result is a loss to 
each student whose development is in this way retarded, 
there are also obvious costs to her institution, department, 
and future profession — and thus to society. Rather than 
abruptly halting an antidevelopmental process of dimini.sli- 
ment often begun much earlier at home and school, in all 
too many cases our campuses clearly reinforce this damag- 
ing trend. 

It seems dear that colleges do not sen^e to reduce many of 
the stereotypic differences between the sexes, ... It would 
seem that these programs sene more to preserve, rather 
than to reduce, stereotypic differences between men and 
uxmien in behavior, penonality, aspirations, and achieiv- 
mentiKslin 1977, p. 216). 

Summarizing his major follow-up study 15 years later, Astin 
0993) uses virtually identical W'ords (p. 405). Reviewing 
research on the effects of student peer culture on w'omen 
students, Baxter-Magolda (1993) asks, “What context allows 
the peer culture to have such a devastating effect on 
women’s ^^e\'elopment during their undergraduate years?” 

(p. 372). And writing of w'omen students in science, Tobias 
(1990) states her research suggests, at least for scientists, 

"the ‘crisis' in science education is not yet their problem, 
but rather the nation’s" (p. 12). We need to see as our 
nroblem the well-being, persistence, and success of each 
one of our women students. 

Members of racial and ethnic minority 
groups on campus 

"Perhaps more than any other institution in our society, it 
is the college that is cmcially important to advancing pros- 
pects for black and Hi.spanic students” (.Hoyer 1987, p. 39). 
Yet the uncertainty, confusion, and anxiety many, if not 
mo.st, .students of majority groups feel in college can be 
substantially increased for .students of racial and ethnic 
minority groups at primarily white institutions. What is 
the quality of the campus climate for students from minor- 
ity groups? 

In many cases, minority-group students bring with them 
to college inadequate academic preparation and poorly 
developed study skills and habits, and they can find it dif- 




ficult to comprehend the often highly abstract content of 
their courses. On primarily majority-group campuses, many 
students from minority groups are often aware of their 
unconventional speech patterns and may fear saying some- 
thing inappropriate when speaking in class, reducing their 
active participation (Saufley, Cowan, and Blake 1983). 

They may be shunned by majority-group students. They 
may feel guilty for consuming a disproponionately large 
share of their family’s resources. And they may fear being 
thought academically inferior on campus. According to a 
University of Chicago survey, 53 percent of white Amer- 
icans stated that African-Americans and members of other 
minority groups are less intelligent than they; 30 percent of 
African-American respondents agreed with the statement 
(Raymond 1991). Many of our students may themseh es 
suffer from such a deadly misconception. 

"Study after study reports the experiences of minority stu- 
dents from all backgrounds who encounter racism and 
overt or subtle forms of discrimination by other students or 
faculty" (Smith 1989, p. 22). Campus Life: In Search of 
Com expresses concern "about the racial tensions on 
campus, the lack of trust, the singular lack of success many 
colieges and universities have had in creating a climate in 
which minority students feel fully accepted on campus" 
(Boyer 1990a. p. 3D. According to the repon, two-thirds of 
the presidents at research and doctoral universities cited 
“racial tensions and hostilities" as problems on their cam- 
puses (Boyer 1990a). Of 3,119 students at eight Ivy League 
institutions, 73 percent of all respondents and 81 percent c')t 
African-Americans perceived racism as a problem on cam- 
pus ("Ivy League" 1993). In the words of an African- 
Ajnerican student at Columbia University, “Blacks . . . are 
admitted to Columbia, but they do not belong" (Bernstein 
1990, p. 23). 

Other instances are prevalent in the literature. At the 
University of Maryland-Baltimore County, for example, 
about one-fifth of minority-group students had suffered elh- 
noviolencc (chiefly psychological in the form of verbal 
abuse) on campus many repeatedly, one- third said their 
interpersonal relations had been “seriously affected." and 
an “overwhelming majority perceived themselves to lx* 
potential targets of discrimination" (F.hrlich 1988, p. IS). 
Jewish and Asian .students had experienced similar amounts 
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of eilinoviolence. At St. Cloud Slate University, 50 percent 
of minority-group and international students claimed to 
have heard make racist comments, and i6 

percent had had elhnoviolence directed toward them in 
their residences on campus; 65 percent of the minority- 
group and international faculty had experienced disrespect 
Irom while students related to their race or nationality. 

"The consistent theme ol alienation experienced by sli'- 
denis of noniradiiional backgrounds in their campus en\ i- 
ronmenls is symptomatic of a deep underlying problem 
that has not been adequately addressed" (Smith 1989, p. 
19). To what extent is it our responsibility to address ihi'^ 
moral issue? 



Tu the decree that issues of racism, sexism, homophobuf, 
and the general presence of an alienating environment 
also affect performance, then lack of peiformance cannot 
be focused entirely on the student. All too often we hare 
assumed the institution 's perfection and students' inconv 
petence iSmih 1989. p. 6-4) 

How do gifted minority' -group students fare on campus? 

A decade-long longitudinal study of Illinois high school 
valedictorians and salutatorians explored in detail the ex- 
periences of eight African-American and Latina students 
(Arnold 1993). These gifted students also told of neglect, 
low expectations, discouragement, and demeaning beha\ior 
frcjm faculty'. As one put it. "They just go and lecture, they 
don't care” (p. 270). With "the predominantly while univer- 
sities that the students attended Imirroring and replicaiingl 
larger oppressive structures in society'" (p. 279). how did 
these students manage to succeed? "The lop high school 
students of color make it through persistence, hard work, 
and almost unbelievable personal will" (p. 280), despite 
higher educations failing "ev'en the ‘best African-American 
and Mexican-Amcrican students" (p, 280). 

The degree to which African-American students "disiden- 
lify“ with their institutions is a better predictor of their 
grades than even the quality of their educational prepara- 
tion for college (Steele 1992), Seventy percent of African- 
Ainericim students in one study withdrew from four-year 
colleges, compared to 45 percent of w hites. and African 



96 



American — and white — students with SATs of 1200 to 1500 
were just as likely to drop out of college as those with 
SATs of 800 (Steele 1992). An unsupponive campus climate 
is a major cause of minority-group students’ withdrawal 
from college. “Evidence is growing that the poor quality of 
minority students’ life on campus and their sense ot i.sola- 
tion, alienation, and lack of support arc more serious fac- 
tors in attrition’’ (Smith 1989. p. 22) than their relatively 
poor preparation for academic work. Graduation rates of 
white .students from New Jersey state colleges, for exam- 
ple, are about three times greater than those of African- 
American and Hispanic students, and about twice the rates 
of Asians (Goldberg 1993a). Similar comparative graduatiim 
rates for the state’s community colleges are uvice as great 
for whites as for Asian.s, tour times as great for whites as 
for African-Americans, and seven times as great for whites 
as for Hispanics. We are far from effective in educating our 
minority-group students and enabling them ti5 persist suc- 
cessfully to graduation. “It is . . . clear that the academic, 
social, and psychological worlds inhabited by most non- 
white students on predominantly white campu.ses are sub- 
stantially different in almost every respect from those cjf 
their v.'hite peers" (Pascarella and Terenzini 1991. p. 64-t). 

During the la.st decade, many in.stitutions have estab- 
lished special retention programs whose avowed purpo.se is 
to help minority-group students succeed. "The fact ot the 
matter is that there have been few consistent succe.s.ses, 
especially at predominantly white institutions" (Anderson 
n d.). Two primary factors underpin the common failure ot 
college retention programs to have their intended effect on 
nonwhite students; (1) our development of such priigrams 
on the basis of “Anglo-European notions about cognith e 
functioning, learning, and achievement"; and (2) the tailure 
of these programs “to identify the cognitive assets and 
learning preferences ot nonwhite students (Anderson 1988, 
p. 3). Rather than adapting to our .students, we demand 
that they adapt to us. The implications for minority stu- 
dents in the natural sciences and technolog>' may illu.strate 
the potential consequences of our inattention to these .stu- 
dents' needs. 

Given the acknowledged need for much greater repre- 
sentation of minority group members in scientific and tech- 
nological professions, the campus climate has direct and 
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specific effects for society we cun no longer ignore. Muny 
of the.se professions require graduate-level education. 

The dynamics of graduate and professional education for 
minorities have as [their] most direct underpinning the 
counseling, guidance, and mentoring of minority under- 
graduates. For those minority students who do make it to 
undergraduate school, a major proportion of these indi- 
niduals are somehow turned off to graduate education. 
One contnhuting factor is the lack of interest exhibited hy 
many active Pb.D. researchers in the counseling, develop- 
ment, and long-term placement of these and other under- 
graduate science majots. Indeed, a . . . four-year study of 
biology undergraduate majors at Brown University indi- 
cated that less than 10 percent of these graduates mattic- 
ulated into science graduate programs one year after 
graduation. . . . Given the historic changes in minority 
student enrollment in majority institutions since the late 
1030s and early 1000s, majority four-year colleges and 
univeisities in the Lnited States now enroll approximately 
82 percent of all [African-American] undergraduates. 

I IBCU [historically black college and university] graduates, 
bouever, represent 32 percent of all [African-Americans] ’ 
earning science and engineering Pb.D. s, 34 percent of 
physical science Pb.D. s, 37 percent of math Pb.D. 's, and 
33 percent of computer science Pb.D. 's. ... A greater pro- 
portion of the minority science majors at HBCUs tend to 
go on to graduate programs veisiis their counterparts at 
majority institutions (Sflychc and Frierson 1990 pp 
989-90;. 

Ot the top 20 institutions granting bachelor’s degrees to 
minority-group .students who later earned Ph.D.'s from 1986 
to 1990, 17, or 85 percent, were HBCUs (Stimpson 1992). 

Of 6,320 African-Americans who earned doctorates in all 
fields from 1975 through 1980, 55 percent had earlier grad- 
u.ited from 87 HBCUs and 45 percent from 633 primarily 
white colleges and universities (Sudarkasa 1987). Fighty 
percent of African-American, Hispanic, and Native Aaneri- 
can college graduates receive their degrees from 20 percent 
of U.S. in.stitutions, many of which have served predomi- 
nantly minority group students (Deskins, cited in Richanl- 
son and .Skinner 1991). The relative success of these in.stitu- 
tions with minority-group students is .somewhat ironic. 
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Minority-group students are concentrated in institutions 
that have the most limited resources (Ridiardson and Skin- 
ner 1991). 

Despite the urgent need for minority faculty members, 

“the intolerably small pool of qualified minority applicants 
represents a shocking weakness, if not an indictment, of 
American education at all levels” (Boyer 1990b, p. 66). "Bor 
many minority students, particularly [African-AmericanI stu- 
dents on predominantly white campuses, suivival in a hos- 
tile environment is the preordinate goal and radically alters 
the usual standards of quality against which the student 
experience might be compared” (Kuh, Krehbiel, and Mac- 
Kiiy 1988, p. 29). The reason that African-American and 
Hispanic students attend graduate school in low numbers is 
a result of their low rates of completing the bachelor s 
degree (Adelman 1990, p. 242). Given the special difficulty 
majority institutions experience in graduating African- 
American males, the finding that academically oriented men 
are at special risk for dropping out of college is of special 
interest (Brower 1992). 



Conclusions 

“Measures of cognitive development typically provide a 
report that reveals enormous gaps between minority and 
majority students. [And] trend analyses usually reveal little, 
if any, progress being made to eliminate the gaps” (Nettles 
1991, p. 1). Minority students in particular bring with them 
to college Wo strongly positive characteristics that can 
make them unusually rewarding to work with (Saufley, 
Cowan, and Blake 1983). Birst, and "perhaps most impor- 
tant, minority-group students are generally characterized by 
strong conunitment” to education or, perhaps at first, to 
helping their home conimunity (p. 13). Second, "minority 
students are also generally characterized by an amazing 
perseverance. ... If they are given a chance to see that 
they can succeed at the university, they exhibit a tenacious 
determination to work through or to beat the system” (pp. 
13—14). Tc^day, numerous resources are available to provide 
assistance in improving the college experience for minority 
students (Adams 1992; Border and Chism 1992; Cones, 
Noonan, and janha 1983; Richardson, Matthews, and 
Finney 1992; Smith 1989; Wright 1987). 
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The research reviewed liere sliows dearly the unequal 
and antidevelopmental treatment we accord many of our 
students, Improving the climate and quality of community 
experienced by all students should dramatically improve 
their ability to succeed — and thus the quality of our 
outcomes. 
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ACADEMIC ADVISING; Guiding Deveiopmeat 



Our students come from widely different family back- 
grounds and schools, with diverse values, goals, styles of 
learning, and levels of self-esteem and abilities. Fev/ have a 
sophisticated understanding of higher education or skills in 
personal or career planning, and many have never been 
taught how to learn or been informed of the need to take 
an active role in their own learning. Large numbers are 
underprepared for the academic work we ask of them. 

In college, students suddenly find themselves in a new', 
strange, and, for many, much more demanding and stress- 
ful environment than they have previously known. The 
quality of guidance they receive can markedly affect the 
degree to which they profit from their years at college. 
Their ability to understand their own development, clarify 
their personal values and goals, plan an appropriate devel- 
onmental curriculum and other educational experiences, 
and feel emotionally secure, integrated, and at home on 
campus can all affect their degree of success, indeed, their 
very' decision to remain in college. Academic advising by 
faculty provides a choice opportunity for close contact 
between students and faculty out of class, one that can 
have a major effect on students' values, goals, and behavior 
and significantly increase their satisfaction with college and 
thus persistence. Students who have no contact with faculty 
outside class experience “significantly lower growth in prin' 
cipled [ethical] reasoning” (McNeel 1994, p. 37). Racial ten- 
sion is more likely on campuses ‘‘where there is a lack of 
concern for individual students" (Hurtado 1992, p. 562). 
High-quality academic advising unequivocally demonstrates 
our concern fu; each person throughout the college years 
and can provide the personal validation essential for stu- 
dents’ success (Rendon 1994). 

Entering students’ expectations could confirm the need 
for close attention to advising, especially during the first 
year. The CIRP suivey of first-year students in fall 1992 
reveals that only 43. 3 percent estimated the probability w'as 
‘‘very good" they would make at least a B average; a mere 
14.2 percent believed they w'ould graduate w'ith honors 
(Collison 1993. pp- A30-A31). Although many students 
enter college knowing little of themselves or of the w'orld 
of work and many have substantial personal problems, few 
expect to seek \ ocatiunal counseling (5.1 percent) or indi- 
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vidual counseling (37 percent) {Chronicle 1991). Entering 
students need the personal challenge and reilection good 
advising provides to refine their personal values and goals. 
“Being well-off financially” was an essential or very impor- 
tant objective for 73 percent of student respondents in 
1992. In fact, 69.8 percent of the students agreed that “the 
chief benefit of college is that it increases one’s earning 
power.” In contrast, only 45.6 percent had as an essential 
or very important objective “developing a meaningful phi- 
losophy of life.” Students’ social and political oerspectives 
seemed at best narrow. Only 38.8 percent had as an essen- 
tial or very important objective “keeping up to dale with 
political affairs," a mere 20.1 percent "influencing the politi- 
cal structure." The need and opportunity for developmental 
advising in this democracy are great. 

With regard to our guiding and counseling students, “we 
simply have to recognize that this is probably the most 
impoirant kind of leaching we do and that these encoun- 
ters are second in significance only to the daily life with 
other students” (Chickering 1969, p. 252). Academic advis- 
ing is “a high calling” (Johnston, Shaman, and Zemsky 
1987, p. 69), and “a college of quality has a year-round 
program of academic advising and personal counseling, 
structured to serve all undergraduates, including part-time 
and commuting students" (Boyer 1987, p 289). 

Developmental Advising: Keystone of 
Educational Quality 

Effecr*ve high-quality advising today is developmental in 
design (Crookston 1972). Based on an ongoing relationship 
bctu'een student and adviser, developmental advising helps 
each student become more aware of his or her values, per- 
sonal characteri.stics, and needs, and assists him or her in 
setting goals, making plans for postgraduate life and a 
career, and using opportunities for development effectively, 
thus solving problems and building self-esteem. Quality 
developmental advising can be conceived of as the hub of 
each student’s experience on campus (Ender, Winston, and 
Miller 1982). Through a mentoring relationship with an 
adviser, a student can understand and plan his or her time 
in college. The adviser and student together can identify 
special developmental needs that interfere with learning 
and development, such as inadequate learning skills or 
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learning disorders (Schmidt and Sprandel 1982), emotional 
concerns (Altmaier 1983, Hanfmann 1978; Whitman, Spend- 
love, and Clark 1986), social relationships, and health is- 
sues, and then determine resources available for dealing 
with them. Developmental advising is pivotal to the quality 
of an institution’s educational process, for "academic advis- 
ing can be conceived as the institution’s quality control 
mechanism" (Winston, G rites, et al. 1984, p. 539). Develop- 
mental advising ensures the institution knows each student 
as an individual and understands and meets his or her 
needs. Rather than using summative assessment to w'eed 
out the unfit ("defect detection"), developmental advising 
functions as "defect prevention," ensuring that on gradua- 
tion all students meet the criterion of "fitness for use." 

Several studies demoastrate a positive relationship be- 
tween academic advising and students’ achievement, satis- 
faction with college, personal, social, and vocational devel- 
opment, and p^iSistence on campus (Saunders and Erv'in 

1984) . A positive association between self-esteem and aca- 
demic performance suggests that, beyond improving their 
study skills, building students’ self-esteem may be a good 
way of improving tlieir academic success (Covington 1989). 
Developmental academic advising is an excellent w'ay to 
foster sustained improvement in students’ self-esteem and 
their study habits as well. 

High-quality advising has a significant positive effect on 
students’ persistence on campus by increasing their achieve- 
ment and satisfaction and thus reducing their intent to with- 
draw (Pascarella and Terenzini 1991). A study of 947 institu- 
tions, for example, reveals that improved advising increased 
students’ persistence on campus more than 25 percent (En- 
der, Winston, and Miller 1984). Better academic advising is 
therefore often recommended as a means of improving 
retention among students (Forrest 1985; Noel 1985; Saluri 

1985) . Over half of first-year students in one study who 
lacked significant involvement with an institutional author- 
ity, such as a teacher or adviser, failed to return to campus 
for a second year (Noel 1985). In another study, a sample 
of 1,033 students, 51.1 percent of all first-time, first-year 
students, at a large public, urban commuter university in 
the Midwest, rated the quality of the academic advising 
they had received (Metzner 1989). Fully one-third had re- 
ceived no advising at all, and, of those students, 35 percent 
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were lost to the institution within one year of entry. Stu- 
dents who perceived their advising to be of good quality 
withdrew at a rate 25 percent less than those with poor 
advising and 40 percent less than those who had received 
no advising at all.* 

How Good. Is Our Advising? 

Academic advising as it is generally now practiced in this 
country functions primarily as a means of dispensing infor- 
mation to students, such as requirements for registration and 
graduation, rather than seiving as a powerful developmental 
tool to foster students' retention and .success. ‘‘Advising in 
academic departments is view'ed more as a clerical registra- 
tion function than as a process in which the [adviser! inter- 
venes at critical times” (Habley and Crockett 1988, p. 33). 

Authorities on advising today recommend an intrusive 
approach that actively seeks out students and ensures qual- 
ity advising for each one, but institutions tend not to be 
intrusive. A large number, perhaps even most, do not 
require their students to consult an adviser even for such 
weighty issues as declaring a major, unsatisfactory progress, 
and withdrawal from the college (Habley and Crockett 
1988). We passively wait for our students to come to us. 

Three hours per year is the minimum amount of time 
each student should spend with an adviser (Winston, Miller, 
et al. 1984), and ‘‘any college arguing that it cannot orga- 
nize its personnel and budget to accomplish this modest 
proposal ... is suspect as a viable educational institution” 
(p. 545). "Short, limited, and irregular interactions betw'een 
(advisers and studentsl seldom have lasting impact" (Ender, 
Winston, and Miller 1984, p. 16), even though a third of 
nearly 20,000 students from 55 colleges in one study 
claimed usually to spend only 15 minutes when visiting 
their advisers during each of two or fewer visits a year 
(Noble 1988). For all respondent institutions in the same 
survey, the reported modal amount of faculty time spent 
advising was between 1 percent and 5 percent; a mere 3 
percent of institutions reported more than 15 percent of 



• Sco Salun 1985 for a distussKin of programs that have signifitanlly 
improved retention by ruLsinj? the quality of advising. 
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faculty lime devoted to advising across all departments 
(Habley and Crockett 1988). In another national study, 55 
percent of faculty spent four or fewer hours per week in 
contact of any sort with students outside the classroom 
(Finkelstein 1984). 

Students’ satisfaction with advising reflects our inattention 
to this key educational process. “According to several 
national surveys, undergraduates lend to be more uissaiis- 
fied with academic advising than with almost any other ser- 
vice they receive" (Aslin 1987, p. 16), rating college advis- 
ing programs “highly adequate" in 17 percent (academic 
advising), 9 percent (personal advising), and 7 percent 
(vocational advising) of cases in one survey (Boyer 1987). 

In a national study of the effects of college, only 44.1 per- 
cent of students said they were “satisfied" or “very satisfied" 
with advising on their campuses (Astin 1993). 

The Necessity for Training 

Most academic advising is conducted in academic depart- 
ments. Ovewhelmingly, it is the faculty who advise our 
students: 80 percent of all advising in one sample of 754 
colleges and u.niversities (Crockett and Levitz 1984). Re- 
gardless of who the advisers are, however, “training is one 
of the most important ingredients of an effective advising 
program" (Gordon 1984, p. 461). Yet faculty members are 
still ordinarily untrained for this important and complex 
work, approaching this responsibility unequipped with 
knowledge of student development and without the requi- 
site skills in communication, counseling, decision making, 
or career planning. 

Training for advisers is not mandatory in department 
in 44.6 percent of institutions in one survey; it is mandatory 
in all departments in only 26.2 percent. In only 29.2 per- 
cent of the institutions with mandatory training (7.7 percent 
of all institutions) was this training said to be conducted 
systematically (Habley and Crockett 1988). Any training that 
does exist tends to focus on transmitting information to stu- 
dents: rules, policies, and procedures to follow. Training of 
some sort in such key skills as counseling, interviewing, 
and decisu)n making is conducted in relatively few depart- 
ments: 20.5 percent, 14.7 percent, and 11.4 percent, respec- 
tively. More surprising yet is the limited training provided 
for even the staffs of campus advising offices, where advis- 
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ing is often a full-time endeavor. Sixty percent of such 
offices provide no training whatever or do not mandate it. 

Evaluation, Recognition, and Reward 

The low esteem in which colleges and universities hold 
advising is indicated by the limited recognition accorded 
this complex and demanding task. Recognition and reward 
for advising in those few institutions where they exist at all 
are most often only “a minor consideration in the promo- 
tion and tenure process” U-labley and Crockett 1988, p. 41). 
When asked how they would rate their advising programs, 
college officials in one survey rated accountability, training, 
evaluation, and recognition and reward for work as an 
adviser least effective out of 11 stated characteristics 
(Habley and Crockett 1988). 

T})e most significant methods by which advising can be 
improved are seen as both the least effective and least 
improved areas in the organization and administration 
of ca mpi iS advising p rog ra n is . Tra in i ng, accou ntabil ity, 
evaluation, and recogyiitioiv' reward are the cornerstones 
of performance in every field or job. Yet those cornerstones 
continue to be stumbling blocks in most advismg pro- 
grams (Mdb\ey and Crockett 1988, p. 68). 

“This apparent lack of concern on the part of institutions 
with the effectiveness and outcomes of their advising pro- 
grams is disappointing and difficult to understand" (Crockett 
and Levitz 1984, p. 44). 

Conclusions 

Not surprisingly, students perceive our apparent indiffer- 
ence toward our relationships w'ith them. At the University 
of California, before the main incursion into colleges of the 
"new" students, 75 percent of freshmen and 63 percent of 
seniors stated they had no one on the faculty “whom they 
felt was particularly responsible to or for them” (Chickering 
1969, p. 252). Thirty percent of seniors, looking back on 
their college experience, "felt that very few or no faculty 
members were reaily interested in students” (p. 252). And 
research provides scant evidence of change in the quality 
ot“ advising over the 25-plus years since then. 
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Findings . . . depict a somewhat disappointing picture of 
the stat ? of academic advising in American colleges and 
univetsities . 7he results, particularly when compared to 
those from earlier advising surveys [in 1979 and 19831, 
reveal little or no improvement . . . (Habicy and Crockett 
1988, p. 74). 

Developmental academic advising became no more com- 
mon in American colleges and universities during the 1980s 
than it was in the previous decade: It “is still more promi- 
nent in theory than it is in practice" (Habley and Crockett 
1988, p. 67). “Academic advising is scandalously poor in 
higher education” (Johnston, Shaman, and Zemsky 1987, p. 
69). Apparently the advising we offer our students in gen- 
eral continues the inadequate quality of the guidance most 
of them received in high school (Schmidt 1993). And con- 
cerns have been raised about the quality of advising at the 
graduate level (Mooney 1991). 

“Faculty perceive that they provide much more beneficial 
advisement than students feel they receive. Students per- 
ceive a vast difference between what faculty advising 
should be and what it is" (Kramer and Spencer 1989, p. 
105). Surprisingly, although 79 percent of presidents 
responding to a 1989 survey stated that poor academic 
advising was a problem on their campuses, only 14 percent 
believed it was a greater than moderate problem (Boyer 
1990a). Apparently, students’ and experts’ perceptions of 
quality vary significantly from those of many faculty mem- 
bers and administrators. 

“Greater efforts will have to be made to advise and coun- 
sel students if they are to actually complete the programs 
in w’hich they enroll’’ (Solmon 1989, p. 36). Clearly, if col- 
leges and universities are to produce the fair outcomes for 
all students society requires today, we w'ill have to change 
our advising significantly. 




Apparently, 
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CAN TODAY’S STUDENTS LEARN? Achieving 
Success with High Standards for All 



Given our students’ common underpreparation for academic 
work and our striking lack of success in graduating many 
of them, some observers have asked whether today’s di- 
verse students, coming as they do from such disparate 
backgrounds, can reasonably be expected to succeed at a 
high level. Does widespread access to higher education by 
necessity preclude achievement of high-quality outcomes? 
Can these students learn? 

Engaging the interest of our students and motivating 
them to the high quality of effon required for excellent 
achievement are no mean feats. Some faculty believe many 
students simply lack the intellectual equipment required to 
learn; achievement of a high school diploma may be the 
most to which they can realistically aspire. Research and 
experience elsewhere, how'ever, suggest that understanding 
more fully the backgrounds and developmental and contex- 
tual reasons our students behave as they do can greatly 
enhance our ability to help them develop. 

Professional opinion today views students’ aptitudes as 
products not only of heredity but also of experience, not *a 
list of independent, fixed entities aKvays in force . . . [but] 
exhibited in consort as resultant strengths or weaknesses 
relative io present and past conditions” (Snow 1986, p. 

1037, emphasis in the original). The educational process 
must adapt to each individual if all are to succeed. 

Specific and compelling evidence suggests we can be 
successful in fostering the development of virtually all our 
students to far higher levels than we have in the past. 

Using modern methods, some colleges and universities are 
now achieving striking results in retaining their students on 
campus and graduating them successfully. The research 
reviewed in this monograph strongly suggests that, by 
determinedly focusing on improving the quality of their 
educational processes, many institutions can achieve dra- 
matic gains in .student development. 

Working with public elementary and secondary school 
students, who are in most cases far less rigorously selected 
and therefore much more heterogeneous and representati\e 
of Americans generally than are most college students, cer- 
tain individual teachers and schools have, by dint of their 
enthusiasm, empathy, imagination, and technical profes- 
sional skill, achieved startling results under improbable 
conditions. For example, Jaime Escalante, whose work has 
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become well known nationally through the film Stand and 
Deliver, for years against daunting odds taught calculus in a 
Los Angeles barrio. These 98 percent Latino young people, 
[relieved by many unable to learn higher-level mathematics, 
consistently passed the ETS Advanced Placement Test in 
calculus at rates higher than students from all but a small 
number of far wealthier schools (Mathews 1992). These stu- 
dents went on to college in significant numbers, including 
to institutions of stature. 

Henry Levin (1991) has developed accelerated schools 
where most students are at risk for failure, coming from 
impo'^erished, poorly educated, ethnic minority families 
(Wells 1989). By giving these students experiences typical 
of programs for the gifted and talented rather than reme- 
dial classes. Levin has dramatically improved their rate 
of learning. 

The potential of schools and colleges today is suggested 
by a search for instructional methods that could increase 
productivity in teaching (ElLson 1986). This study uncov- 
ered 125 different methods that were at least twice as effec- 
tive as more traditional methods used in ex|jeri mental con- 
trol groups on at least one index of productivity, such as 
effectiveness, cost, or instructional time. 

Solving the Two-Sigma Problem 

Benjamin S. Bloom and his doctoral students at the Uni- 
versity of Chicago established that high school students 
tutored one-to-one, one-to-two, or one-to-three in various 
subjects achieved test scores averaging about two standard 
deviations or "sigmas” higher than sin.ilar students taught 
by conventional group instmetion (Bloom 1984). In other 
words, the average tutored student performed better than 
98 percent of the conventionally taught students. With 
tutoring, 90 percent of the students reached the level of 
performance of the top 20 percent of conventionally taught 
students. "The tutoring process demonstrates that most of 
the students do have the potential to reach this high level 
of learning” (p. 6, emphasis in the original). Compared 
with conventional group methods, however, tutoring is a 
very labor-intensive and thus expensive form of instruction. 

Using masteiy learning, a well-researched method of 
instmetion (Block 1971; Bloom 1976; Guskey 1988; Kulik, 
Kulik, and Bangert-Drowns 1990; Levine and Associates 
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1985), the researchers consistently achieved a full one- 
sigma increase in assessed learning over conventional 
instruction; the average masteiy student scored higher than 
84 percent of those in the conventionally taught class. With 
mastery methods, 70 percent of the students achieved a 
level equal to only the lop 20 percent of conventionally 
taught students. The researchers also discovered that the 
variation in amount of learning among students also 
changed dramatically, becoming much smaller in mastery 
groups. Taken together, these results demonstrate that the 
higher the quality of instruction, the less relevant to achieve- 
ment are the entenng student's abilities. Or, “the better the 
coaching, the less the correlation between height and suc- 
cess in basketball’* (Baird 1985, p. 73). 

In a search for those variables that have the strongest 
effects on learning, W/’alberg (1984) reviewed and sum- 
marized 3,000 empirical studies of students' learning in 
schools conducted during the previous 50 years. By manip- 
ulating certain of those variables, Bloom’s group by 1984 
was able to close fully the two-sigma gap between the out- 
comes produced by tutoring and conventional instruction 
with six different methods of group instruction. And opti- 
mizing all nine of the strongest variables Walberg identified 
should improve learning by 3-7 standard deviations or sig- 
mas over current achievement produced by conventional 
methods (Walberg 1984, p. 24). 

Bloom’s group found that the higher the quality of 
instmetion, the lower the correlations between students' 
assessed aptitude and their achievement. This correlation 
was .60 for the conventionally taught control groups in the 
studies. With masteiy^ learning methods, the correlation 
dropped to .35 and with tutoring to .25 (Bloom 1984). In 
other words, improving the quality of instmetion dramati- 
cally reduced the impact of students’ abilities upon entry' 
and enabled all of the students to learn at a high level. 
According to Bloom, the research is relevant to all levels of 
education, “including . . . college and even graduate and 
professional school” (p. 8). 

Higher-order thinking 

Dramatically improved learning is not limited to low'-level 
facts and concep.,-) alone. W'hen comparing university stu- 
dents’ learning from conventional instmetion by lecture 
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with discussion groups using new materials and methods, 

‘ these and other approaches [make] it clear that most stu- 
dents could learn the higher mental processes if they be- 
came more central in the teaching-learning process" (Bloom 
1984, p. 15, emphasis in the original). (Other research by 
the same group produced a 1.7-sigma increase in higher- 
order cognitive processes over conventional instruction.) 

The potential Jbr human development in college 

Bloom’s findings with ordinary students in schools are con- 
sistent w'ith later studies by his gi'oup, of 120 Americans, 
each rated among the top 25 people in his or her field 
(Bloom 1985). In the later studies as well, in addition to 
motivation and effort, environmental factors were consis- 
tently essential to their success: chance opportunities and 
the very high standards (challenge) and guidance and 
encouragement (support) of teachers. 

“Individual deferences in school learning un^*=r very 
favorable conditions of schooling will approach a vanishing 
point . . . ’ (Bloom 1976, p. 6). “What any person in the 
world can learn, almost all persons can learn if provided 
with appropriate prior and current conditions of learning" 
(p. 7, emphasis in the original). 

If these dramatic results can be achieved with ordinary 
students in schools, results with our often much more highly 
selected and therefore “able" college students can surely be 
as impressive. 

We now have lots of research that shows that intelligence 
IS essentially made up of learnable skills. This means we 
can teach intelligence! Students gain intelligence in col- 
lege depending on what they study and how they learn. 

No longer can we dismiss students' aspirations as if they 
are in some kind of hopeless situation. . . . Rather, there is 
now evidence that we can work with students at all levels 
of ability {UcKe'AchxQ 1991, p. 226). 

Success in Mathematics for Minority Students 

On many campuses, undergraduate calculus courses are 
notorious for their low pass rates, and disadvantaged stu- 
dents with weak mathematics backgrounds are especially at 
risk in such courses. But a marked departure from tradi- 
tional methods for working w'ith students in academic diffi- 




culty at the University of California-Berkeley that empha- 
sized cooperative learning methods and veiy high stan- 
dards rather than remediation achieved a high level of suc- 
cess with minority group calculus students (Treisman 1985). 
Over a decade, more than 40 percent of African-American 
nonprogram students regularly failed calculus each term 
(grades of D+ or lower); of African-American students in 
the program, however, over seven years only 3 percent 
failed and repeated the course unsuccessfully. Less than a 
quarter of non program African-American students obtained 
a grade of A or B in calculus, and their grade point aver- 
ages in their mathematics courses were near the university’s 
cutoff for probationary’ status. More than half of the stu- 
dents in the program, however, received A’s and B s; their 
grade point averages in these courses w'ere similar to the 
overall class average. Most Berkeley students who with- 
draw from the university do so during their first two years. 
Only 57 percent of nonprogram African-American students 
persisted to their fourth semester, while 74 to 78 percent of 
African-American students in the program, regardless of 
their admission status, persisted to that point, the rate for 
Berkeley students as a whole. After five years, only 41 per- 
cent of African-American students at Berkeley had gradu- 
ated or still remained on campus, compared to 65 perceiU 
for program completers (and 66 percent for the overall 
campus). Ten percent of nonprogram Al'rican-American cal- 
culus students finished college in math-based majors, 44 
percent o program completers. 

The ability of minority group students to succeed in 
mathematics is further underscored by experience at the 
University of Texas-Austin. Under a similar program, 23 
percent of the 500 mathematics majors were minority’ stu- 
dents, whereas 18 percent of all undergraduates were from 
racial minorities (Selvin 1992). Tw^elve of 15 students in an 
advanced Gaulois Theory course, or 80 percent, were 
African-American or Latino. 

A study of primarily Latino students in a similar coopera- 
tive learning program in basic calculus at California Poly- 
technic State University-Pomona reveals substantial corre- 
lation between program participation and achievement in 
the course, achievement in successive calculus courses, 
progress through the calculus sequence, retention in math, 
science, and engineering majors, and persistence in college 
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(Bonsangue and Drew n,d.). For example, 42 percent of 
minority nonworkshop students withdrew from school over 
the six years after entry, compared to only 4 percent of the 
students who attended the workshop. Fully 23 percent of 
non workshop students required six semesters to complete 
the three-semester calculus sequence; only 5 percent of 
workshop participants required as long. 

Graduate Professional Schools: Admission and 
Graduation for Minority Students 

Xavier University of Louisiana is a small private institution 
with limited resources, 95 percent of whose 1,800 students 
are African-Americans from modest academic backgrounds. 
Xavier students have an average combined SAT score of 825, 
which "the Ivy League wouldn’t touch” (Culotta 1S)92, p. 1217). 
Yet Xavier has become “a veritable factory' for producing 
[AI'rican-Amcncan] graduates in science” (p. 1217). Whereas 
nationally the number of African-Americans entering science 
majors in college was dropping, at Xavier their numbers 
tripled, and half of all students major in science. Xavier has 
been first in the nation in African-Americans admitted to 
pharmacy schools and second in admission to medical 
schools; 86.3 percent of its 102 1988 graduates entering 
health professions w'cre African-Americans ("PreHealth High- 
lights” 1988). Although the institution is veiy small, Xavier 
students were admitted to graduate programs in the health 
professions in significantly larger numbers than the much 
more highly selected minority group studenLs from Har\'ard, 
Stanford, Johns Hopkins, and the University of California- 
Berkeley ("Information” 1992). For example. Harvard’s fall 
1985 entering class was both 20 percent minority and drawn 
from the top one-sixth of all applicants (Hodgkinson 1985). 
Xavier students earned graduate degrees at about the na- 
tional rate for all students in these programs. Not surprisingly, 
the keys to success at Xavier include adaptation to students’ 
needs, a strong introductory’ program in the development of 
abstract reasoning, extensive contact with faculty’ outside the 
classroom, strong social support, and a campus climate that 
encourages success CCamiichael et al. 1978; Culotta 1992). 

Educational Effectiveness and Efficiency 

If these methods work their dramatic effects with some of 
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the least well-prepared of our students, w^hat might we 
accomplish with their more experienced peers? A preemi- 
nent indicator of our effectiveness as educators is the pro- 
portion of the students we admit whom we are able to 
graduate. The failure of their students to persist on cam- 
pus — ^the ultimate lack of involvement — is a major concern 
for many institutions. Of all 210,739 first-year students at 
431 two- and four-year institutions who responded to the 
1991 ACE- UCLA CIRP survey, a mere 0.8 percent estimated 
tliey had a “very good” chance of dropping out pemianently, 

1 percent temporarily {Chronicle 1992). About 40 to 45 per- 
cent of all first-time college students do withdraw from col- 
lege without graduating, however (Tinto 1985). For exam- 
ple, the rates of graduation after five years for students 
entering 10 New Jersey public four-year colleges and uni- 
versities in 1983 ranged from 29 percent to 67 percent, with 
an institutional average of 42 percent (College Cutcomes 
Evaluation Program 1990a). The range for students entering 
in 1984 at the 10 institutions was 26 percent to 65 percent, 
with an institutional average of 41 percent (College Out- 
comes Evaluation Program Council 1991). The average five- 
year graduation rate for minority students entering the 10 
institutions in 1983 was 22.9 percent (College Outcomes 
Evaluation Program 1990a), in 1984, 24.2 percent (College 
Outcomes Evaluation Program Council 1990. Although 
some additional students will g/aduate from these institu- 
tions in succeeding years, their number is unlikely to be 
large. In more than a few institutions across the country, a 
majority of students who enter fail to graduate. 

The losses incurred by unnecessary, inappropriate with- 
drawal from college are enormous to these students and 
their families, their institutions, which forfeit significant 
sums of money, the states, and the nation. Although the 
reasons for withdrawal are diverse, evidence suggests the 
quality of our educational processes and the climate we 
create on campus are primary factors affecting the decision 
whether to remain on campus or leave. Only a small mi- 
nority of 10 to 15 percent of college withdrawals result 
from academic failure; in most cases, withdrawal has more 
to do with students’ experiences in college than their char- 
acteristics on entry, particularly the degree to which a stu- 
dent is integrated into the life of the campus (Tinto 1987). 
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Of particular importance are those experiences [that] arise 
from the daily interactions between students and faculty 
outside the classroom. Other things being equal, the more 
freqttent those interactions are, and the warmer and 
more rewarding they are seen to be by the students, the 
more likely is persistence — indeed, the more likely is social 
and intellectual development generally (.Tioio 1987, p. 84). 



Beyond the rates at which we are able to graduate our 
students, an important related concern is our ability to edu- 
cate them efficiently, enabling them to complete their 
degrees in a timely manner and to move into society as 
fully productive members. Undergraduate students are tak- 
ing longer and longer to graduate. The percentage of un- 
dergraduate students in regular four-year programs who 
take five years has doubled during the last 10 years (Kra- 
mer 1993). Only a third of the students at four-year institu- 
tions in Virginia graduate in four years (“Virginia" 1992). In 
1992, the state colleges of New Jersey graduated 37 percent 
of their full-time, first-time, degree-seeking students in five 
years; the two-year community colleges graduated 15 per- 
cent of their equivalent cohort in three years (Goldberg 
1993a). One recent study of 298 colleges and universities 
shows that, after six years, an average of only 54 percent of 
first-time, full-time, first-year students had graduated (Cage 
1993). Another national study reveals that, of students en- 
tering four-year colleges and universities for the first time 
directly from high school, only 23 percent graduated in four 
years (16.5 percent in public institutions). After six years, 
the rate rose to 46 percent, still less than half (Porter 1990). 

Students who are slow to finish can include among them 
many of our most academically able students. Studies by 
the Educational Testing Service have shown that only 51 
percent of college students considered "high-ability" high 
school seniors who had scored in the top 25 percent on 
NAEP (National Assessment of Educational Progress) tests 
had graduated from college in seven years, a pattern that 
was stable through the 1970s and 1980s (Dodge 1991). As 
time passes, increasing frustration, alienation, and accumu- 
lating debt can discourage many students from continuing 
on campus, our institutional inefficiency leading them to 
withdraw. 



Dropping out holds significant fiscal implications for us 
as well. “The fact that we get only half of our students 
through a baccalaureate degree in six years is a condemna- 
tion of higher education. If we were running an automobile 
plant, we would be out of business” (Reginald Wilson, 
cited in Cage 1993). Evidence suggests that, once we admit 
them, we are in many cases not providing the assistance 
students need. 
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Graduate programs suffer some of these same problems. 



''high-ability'' 
high school 



The attrition rate of doctoral students, a decades-old con- ^ ^ U 

cern (“Ph.D. under Attack" 1966) and deemed "disturbingly SeniOrS 
high” (Association 1990, p. 2), is estimated at 50 percent, graduated 

frequently greater in some fields. The median time spent frOtn College 



and doctoral degrees in 1988 was 6.9 years (Association years. 
1990). A study of a large and prestigious Ph.D. program at 
he University of California-Berkeley reveals the average 
time to degree was 9.6 year^:, about 25 percent of a gradu- 
ate’s 40-year career span, and only one-third of the stu- 
dents even completed a degree (Seymour 1992). These 
slow rates of learning and high rates of attrition have signif- 
icant financial implications for our students and for socieCy 
at large. 

Conclusions 

Taken together, old-fashioned methods take a heavy' toll in 
lost human potential and reduced learning productivity in 
colleges and universities. At the same lime, the systematic 
use of methods validated by research holds promise tor 
dramatically improving the value we are able to create for 
both our students and our supporters, and for society more 
broadly. If we would do what works and stop doing what 
does not, virtually all of our students could learn. The next 
section introduces a number of specific methods that have 
proven their worth in effecting high-quality learning. 
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IMPROVING QUALITY; The Need for a Sea Change 



Our students’ sojourn with us in higher education often 
resembles not much a carefully crafted educational 
experience tailored to each person’s developmental needs 
as one of fruit bouncing erratically on a conveyor in a mass 
packing facility. The student experience seems more fre- 
quently determined by academic tradition than research- 
based theory, our educational process more often based on 
expediency — the convenience of administrators and faculty — 
than our students’ developmental needs. To produce high- 
quality results for our stakeholders requires the insights of 
research-based theory rather than what often seems to be 
an atheoretical or lay hypothetical approach to students 
and learning. In many cases, our students lack all but the 
most rudimentary academic advising — often they have 
received none at all — and they receive little assessment of 
their developmental levels or needs upon entry to college 
other than of basic verbal and mathematical skills. Thus, 
neither they nor their teachers have the crucial information 
both require to construct developmental plans and pre- 
scribe activities that can provide an appropriate response to 
their needs. For most students, academic activities appar- 
ently involve classes where they listen passively to authori- 
ties tell them facts; they seem to do relatively little learning 
on their own outside class, rarely work with other students 
or have contact with faculty outside class, infrequently 
reflect systematically about their own development, and 
consider college primarily as a station on the way to a bet- 
ter job and salary. 

Even for culturally and educationally advantaged stu- 
dents, such experiences are ill suited to foster their devel- 
opment. Because of their previous status, however, these 
more privileged students may survive the system, even 
learn quite a bit, and certainly emerge with excellent 
grades. For their less advantaged peers, however, their 
experiences on campus can all too often be developmen- 
tally destructive. Unsure of what to expect in this new and 
foreign culture, frequently consumed by self-doubt, lacking 
adequate academic skills, and fearful of asserting their 
needs to authority, these students often find the college 
experience a frustrating and demoralizing path to failure — 
failure whose impact can last a lifetime. 

The system of higher education in this country is often 
claimed to be the best in the wot Id, and it may well be. 
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Our more than 3,600 institutions provide access to postsec- 
ondary schooling for a larger percentage of our people 
than do the colleges and universities of perhaps any other 
nation. Annually, other countries send 460,000 of their peo- 
ple here to attend our postsecondary institutions (Barbell el 
al. 1995). But, “what if, in light of what organizations could 
be, ‘excellence’ is actually ‘mediocrity?” (Senge 1990, p. 18, 
emphasis in the original). Judged by a standard more exact- 
ing than the current performance of colleges elsewhere, by 
the standard of human potential, by the standard of quality 
modern educational methods can produce, and by the stan- 
dard of what society now requires, we fall far short. Our 
current standards no longer serve us well. Our institutions 
are, for the most part, mere shadows of what they could 
become as engines of human development. 

The pattern of checkered quality and institutional ineffec- 
tiveness suggested by the studies reviewed in this mono- 
graph is fully consistent w'ilh serious concerns repeatedly 
raised in the long series of reports issued over the last 
decade by various government agencies and education 
organizations. These reports, prepared by panels of promi- 
nent academicians and other distinguished Americans, are 
sharply critical of colleges and universities. A number of 
books published during the same period further detail our 
perceived inability to educate our students (see, e.g.. 

Bloom 1987; Huber 1992; Smith 1990; Sykes 1988; Von 
Blum 1986; Wilshire 1990). Other repoits cited earlier are 
equally critical of our ineffectiveness in preparing both 
undergraduate and graduate students in specific disciplines 
and fields. Students’ achievement is related to our own per- 
formance: "Development thrives in a richly interactive and 
personalized environment, a hothouse for intellectual growth. 
The potential for such growth remains largely untapped 
in most institutions of higher learning . . (Kurfiss 

1988, p. 68). 

Widespread agreement among observers suggests we are 
at a watershed in American higher education. The nation’s 
social and economic future depends on a number of clearly 
identified and widely agreed-upon human qualities in its 
citizens, among them well-developed intellectual skills and 
values, the capacity to work well with others, and the 
desii*e for lifelong learning. Our research-based knowledge 
of how these human qualities can be developed is now 
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sufficiently sophisticated for us to nunure development to a 
high level and on a truly wide scale. We cannot, however, 
accomplish this task using what are, in many cases, meth- 
ods unchanged from the 1960s, 1950s, or even before. 

Today, national and slate leaders are calling for a signifi- 
cant restructuring of higher education analogous to the 
process now under way in the K-12 sector (Mingle 1993). 
Few' knowledgeable observers believe isolated repairs 
made here and there — more add-on programs or tinkering 
with or fine-tuning the status quo— are likely to achieve the 
results required or to do so in a reasonable length of lime. 
Society’s needs require fundamental rethinking of how we 
in higher education work. Thus, at the 1992 annual meet- 
ing of the Education Commission of the Stales, the program 
“reflected the growing interest in radical approaches to 
solving higher education's problems” (Mercer 1992). A 
high-level task force has recommended a national council 
be established to develop standards for students’ achieve- 
ment in college and the means to assess achievement of 
those standards (Task Force on Assessing 1992). 

We can modernize our educational processes and im- 
prove our capacity to produce learning in many important 
ways. A number of newer professional practices, if cor- 
rectly applied (often in combination) and systematically 
and systemically managed, hold especially great promise 
for improving the quality and quantity of learning in our 
colleges and univ'ersities. 

1. Clear Missions and Goals: Setting High 
Expectations, Focusing Effort, Reducing Waste 

"If we don’t know where we’re going, we may end up 
someplace else.” “Clarity of institutional purpose, communi- 
cated both through the curriculum and through the con- 
sistency with v/hich the institution acts" (Peterson et al. 
1986, p. 105), is “veiy important” in determining students’ 
outcomes. “An effective college has a clear and vital mis- 
sion. Administrators, faculty, and students share a vision of 
what the institution is seeking to accomplish" (Boyer 1987, 
p. 58). Moreover, "the moment w'e lose sight of the mis- 
sion, we begin to stray, we waste resources” (Drucker 
1990, p. 141). 

Because of their broad language, mission statements 
need to be translated into more specific goals and objec- 
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lives to be fully useful on an operational level (Gardiner 
1989). Authorities today consider an essential foundation 
for all institutional activities — planning, implementation, 
and monitoring quality — a series of carefully slated out- 
comes describing clearly for everyone the results the insti- 
tution and its programs intend to produce. These outcome 
goals and objectives guide the design of the curriculum, 
instruction, advising, and cocurricular activities, and the sys- 
tematic assessment of the actual results these educational 
processes produce, If development is the aim of education, 
as Kohlberg and Mayer (1972) suggest; 

The most important issue confronting educators and edit’ 
cational theorists is the choice of ends for the educational 
process Vl^ithout clear and rational educational goals, it 
becomes impossible to decide which educational programs 
achieve objectives of general import and which teach inci- 
dental facts and attitudes of dubious worth (Kohlberg and 
Mayer 1972, p. 449). 

Of course, both mission siaiemenis and goals must be 
used to be useful, and evidence suggests in all *oo many 
cases we are not now using them. “The American college 
or university is a prototypic organized anarchy. It does not 
know what it is doing. Its goals are either vague or in dis- 
pute’ (Cohen and March 1974, p. 3). Many faculty members 
and others on campus do not understand their institution’s 
objectives (Study Group 1984). “We found at most colleges 
in our study great difficulty, sometimes to the point of 
paralysis, in defining purposes and goals" (Boyer 1987, p. 
59). The result of such confusion can be the adding on of 
programs and activities that could be peripheral to the insti- 
tution’s educational purpose, academic departments’ con- 
trolling specialized pieces of what should be an integrated 
curriculum, and instruction occurring as uncoordinated, 
individual courses often the private preserves of individual 
professors. “Common goals are blurred” (p. 59), effort 
unfocused, resources wasted, and results mediocre. Suc- 
cessfully serving our diverse clients at a high level of qual- 
ity will require us to take far more seriously than we in 
most cases now do the crafting and use of statements of 
our missions and intended outcomes. 
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“All leadership is goal-orienled [and] the failure to set 
goals is a sign of faltering leadership” (Burns 1978, p, 455). 
Through leadership and commitment — and more forceful 
pressure from their external stakeholders — our colleagues 
in the K-12 sector have outdistanced us in efforts to clarify 
intended results. Dozens of national and statewide efforts 
specify demanding outcome “standards” for all students, 
teachers, and institutions (“Stmggling” 1995). “One is hard 
pressed to think of any organization that has sustained 
some measure of greatness in the absence of goals, values, 
and missions that become deeply shared throughout the 
organization” (Senge 1990, p. 9). Clarifying our educational 
missions, values, and goals fjr everyone is a first step we 
can take to move our institutions unequivocally toward 
high quality. 

2. Knowledge of Results: Using Systematic Assessment 
To Create a Culture of Evidence 

Equally as important as clearly defining the outcomes we 
intend to produce is assessing their actual achievement. 
Assessment is essential not only to guide the development 
of individual students but also to monitor and continuously 
improve the quality of programs, inform prospective stu- 
dents and their parents, and provide evidence of account- 
ability to those who pay our way. Nevertheless, “it is rare 
that an institution evaluates its impact on individual stu- 
dents across a coherent spectrum of institutional objectives” 
(Korn 1986, p. 5). In most cases, we simply do not know 
how our students are developing or how effective we are. 
Even today, we often fly blind. 

Given the inadequacy of grades as indicators of students’ 
learning, “the consequent lack of data about [students’] per- 
formance and a college’s leaves the stakeholders in higher 
education . . . with little information about the learning 
outcomes of a single college or system of colleges” (Turn- 
bull 1985, p. 24). Baccalaureate-level results are not the 
only ones shrouded in mystery. A widely publicized report 
on quality in basic medical education states, “The effective- 
ness of an educational program should be measured by 
how well its students perform later in their careers. Most 
institutions of higher education employ short-term mea- 
sures, if any, to determine whether or not their education 
goals are accomplished” (Panel 1984, p. 31). “Outsiders 
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find this peculiar, given academia’s thirst for data and 
knowledge" (Keller 1983, p. 13D — not to mention our vir- 
tually universal trained expenise in research. 

In the absence ot timely and reliable information pro- 
d ced by effective assessment and evaluation, how can we 
be sure of what is happening in our institutions? An addi- 
tional consequence of our failure to assess results regularly 
could be our own misperception of reality, Thirt>'-seven 
percent of faculty respondents to one survey said their 
institutions did an “excellent" job in undergraduate general 
education, and another 38 percent selected “better than 
adequate"; only 6 percent believed their institutions did 
a job that was “less than adequate," 1 percent “poor" 

(Boyer 1989), 

Monitoring results continuously and at every point will 
have to become an important fu' us for us if we are to 
improve the quality of our work as required. Moreover, 
assessment will have to apprise us not only of the out- 
comes produce, but also of inputs — \\\g specific charac- 
teristics of our incoming students — and the quality of our 
educational processes (Adel man 1988, 1989; Anderson et ai, 
19"'5; Assessment Update; Astin 1991; Banta 1988, 1993; 
Banta et al, 1995; Dressell 1976; Erwin 1991; Halpern 1987; 
Hanson 1982, 1989; Light, Singer, and Willett 1990; Mentkow- 
ski et al, 1991), (For assessment in courses, see p, 65,) 

3. Coherent Curricula: Integrating Development 

As the overarching, integrated framework for students’ 
development, the curriculum and its purpose, design, and 
function are fundamental to educational quality, “The cur- 
riculum, too, if properly designed, should intellectually 
integrate the campus. In a purposeful community, learning 
is pervasive" CBoyer 1990a, p. 16, emphasis in the original). 
The studies reviewed earlier strongly suggest many institu- 
tions may need to rethink their curricula. “Traditional cur- 
ricula and course structures are generally insensitive to the 
needs, interests, and abilities of the individual student, 
unaffected by rhe changing needs of society, and inefficient 
in their use of available talents and resources" (Diamond 
1989, p. 188), A necessary starting point for curricular 
design or redesign, as for any other program, is to define 
clearly the .specific outcomes the curriculum is expected to 
produce and then to assess continuously in a valid and leli- 




able fashion both the actual results produced and the qual- 
ity of the curricular processes that produced them, To pro- 
duce high-quality* results consistently, curricula must be 
actively managed. 

Use psychological theory at every point 
Goals and objectives for curricular outcomes, instaiciional 
processes, the cocurriculum, academic advising, and assess- 
ment should all systematically incorporate what we now 
know about our students’ psychological development, such 
as their capacity for abstraction, epistemology, moral de- 
velopment, ego development (Knefelkamp, Parker, and 
Widick 1978; Kronholm 1996; Loevinger 1976; Wealhersby 
1981), capacity for intimacy (Douvan 1981), interpersonal 
social skills (Torbert 1981), and identity CChickering and 
Reisser 199S). Students should be helped to understand the 
implicatiofis of this research and learn to apply it metacog- 
nitively in their own lives. 

If the preeminent outcome we value is students’ cogni- 
tive development, the curriculum should at all points focus 
on producing this result. Thorough slep-by-slep training 
specifically designed to develop critical thinking skills and 
dispositions, and the ability for and habit of melacognilion 
should be planned throughout the curriculum and should 
provide abundant practice with timely corrective feedback 
in diverse contexts (Brookfield 1987; Cromwell 1986; 
Facione 1990, Facione, Sanchez, and Facione 1993; Halo- 
ncn 1986; Kurfiss 1988; Meyers 1986; Paul 1995, Slice 1987). 
We should consciously be developing, in a word, wisdom 
(Sternberg 1990). 



Cognitive detvlopment, although central to our entefpnse. 
is .. . not enough. To the extent that cognition develops 
apan from affective development, it is likely to result in a 
distorted, fragmented conception of reality where one is 
wholly intawure of one's projectiois. Psychopathology^ is 
the likely result. ... An educational system that fosters the 
development of cognitive proc' sses at the expense of that of 
the whole, integrated person fails in its mission if the goal 
is, in part, to nurture people capable of contnbiiting to the 
betterment of society and, indeed, all of life (Kramer and 
Bacclar 1994, p. 39) 
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A Japanese religious sect, among its other antisocial, 
destructive, and criminal activities, produced and released 
in a crowded Tokyo subway the deadly military chemical 
agent sarin, killing and injuring many people, A number of 
Japanese university faculty members linked the attraction of 
the sect for graduates of some of Japan's most prestigious 
universities to the quality of these universities’ curricula 
(WuDunn 1995), These teachers attributed their students’ 
inability to resist charismatic, authoritarian ideology to their 
institutions’ emphasis on memorizing rather than thinking. 
“It reflects a profound crisis in the educational system," 
said one. Students “are absorbing ever greater amounts 
of information, but they don’t acquire the ability to make 
value judgments on basic human values like responsibih 
ity for human life or respect for freedom of the individ- 
ual" (p, A6), 

Here, in the United States, a young man is thought to 
have used the knowledge he gained as a chemical engi- 
neering major at Ruggers University to bomb the World 
Trade Center for a righteous cause, in the process killing 
six people, injuring over a thousand, and causing many 
millions of dollars of damage. These true believers (Hoffer 
1951) are, of course, extreme examples. But how much 
reassurance can we draw from the research reviewed in 
this monograph concerning the critical thinking skills and 
dispositions of the rest of our graduates and their abili*^’ to 
pick their way reliably through the minefields of potentially 
destructive social, political, and religious blather surround- 
ing them? 

Fundamental humane and democratic values characteris- 
tic of well-developed people should be specifically devel- 
oped across the curriculum (Collins 1983; Earley, Ment- 
kowski, and Schafer 1980; McBee 1980; Morrill 1980; 

Valuing 1987; White 1981), At every point, we should build 
our students’ general and academic self-esteem (Ca ifornia 
1990; Covington 1985, 1989; Covington and Beery 1976). 
Students should be specifically taught to understand their 
own emotional dynamics, particularly the interaction 
between their levels of self-esteem and hostile responses, 
and apply this understanding skillfully in their personal 
decision making and interactions with others (Altemeyer 
1988; Layden 1977; Saul 1976). 
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Use available curricular resources 
A wide variety of curricular formats are available that can 
serve our institutions’ diverse missions and students’ needs. 

To achieve a high-quality curriculum, colleges reviewing 
their curricula must seek specific guidance in the profes- 
sional literature on curricular design (see, e.g., Chickering 
et al. 1977; Conrad and Pratt 1986; Diamond 1989; Fincher 
1986; Gaff 1983, 1991; Gaff et al. 1980; Levine 1978; Project 
on Liberal Learning 1991; Project on Redefining 1985; Stark 
1989; Toma and Stark 1995; Toombs and Tierney 1991; 

Wood and Davis 1978; Zemsky 1989). 

4. Research-Based Methods of Instruction: 

Doing What Works 

A curriculuni can only bt? as strong as its constituent courses. 
The design, implementation, and assessment of courses 
require newer, more modern professional methods than we 
generally now use, methods that are known empirically to 
respond effectively to students’ diverse levels of develop- 
ment and styles of learning (see, e.g„ Claxton and Murrell 
1987; Keirsey and Bates 1978; Kolb 1981; McKeachie 1994; 
McKeachie et al. 1990; Myers and McCaulley 1985; Myers 
and Myers 1980; Provost and Anchors 1987; Schroeder 1993). 

The untoward effects of large size on organizational 
effectiveness (see, e.g., Chickering 1969; Chickering and 
Reisser 1993; McKeachie et al, 1990; Sale 1980) means we 
need to make the large small. Every method described in 
this subsection can be used to reduce the effect of large 
size, thereby individualizing mass instruction. 

Systematically designed instruction 

Systematic design provides an overarching framework for 
the many components of instruction. It can help a teacher 
specify imponant developmental outcomes that should be 
achieved, analyze the learning tasks students must perform 
to reach those outcomes, identify the resources required for 
this learning, structure activities for the course, and assess 
the results achieved (Briggs 1977; Davis and Alexander 
1977b; Davis, Alexander, and Yelon 1974; Diamond 1989; 
Gagne and Briggs 1974; Hannum and Briggs 1982; Kemp 
1977; Rothwell and Kazanas 1992; Russell and Johannings- 
meier 1981). Systematic design provides an effective means 
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for organizing the components of instruction of all types, 
for all outcomes, students, instructors, and programs. Al- 
though most teachers in higher education are unaware of 
systematic design, this now-standard professional conven- 
tion should become widely used in colleges and universities. 

Students* active involvement in learning 
Systematic design is the framewoik for planning instruction. 
But what methods of learning can produce the diverse and 
abstract higher-order cognitive outcomes society demands, 
involve students in sustained, intensive work with one 
another, develop a challenging and supportive classroom 
climate that builds self-esteem, specifically teach interper- 
sonal and team skills, develop the capacity and desire for 
lifelong learning, and, in large institutions, personalize mass 
instruction? Clearly, our one-size-fits-all educational tool, 
the traditional lecture, cannot produce these results. 

Diverse forms of individualized instruction that respond 
to students widely divergent styles and rates of learning 
consistently produce greater learning of content than pas- 
sive listening only (Pascarella and Terenzini 1991). “How, 
then, does one reconcile . . . [students’] heterogeneity with 
the homogeneity of most institutions in their . . . curricular 
content and structure, course content and sequences, [and] 
instructional methods?” (p. 645). Today, newer, empiricaliy 
based methods of instruction await widespread use in higher 
education. Some of these methods of individualizing and 
personalizing mass instruction permit even a lecture with 
large numbers of students to include substantial interaction 
among students and between students and teachers. 

We need to ensure our students are actively involved in 
learning at every point, both inside and outside the class- 
room and in both academic and nonacademic, cocurricular 
activities. Ninety-one percent of college and university pres- 
idents in a Carnegie Foundation study said an “important” 
need exists for more collaborative learning among students 
as a means of improving campus life; 33 percent said th^s 
need is “very important” (Boyer 1990a). 

The use of active learning may limit the amount of con- 
tent we can cover in a course, but the research reviewed 
earlier show's that much, if not most, of the conceptual 
materia] W'e now cov'er is poorly learned and soon forgot- 
ten. Under traditional instmetion, students will have cov- 
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ered more but learned less in the sense of meaningfully 
retaining and integrating knowledge (Kurfiss 1983). We 
need to be more selective in choosing the outcomes we 
value most. Describing its new science-as-a-liberal-art cur- 
riculum, the American Association for the Advancement of 
Science states, “The traditional survey course and con- ern 
about ‘coverage’ have no place in the curriculum described 
here” (Projea on Liberal Education 1990, p. xviii). Work- 
shop Physics at Dickinson College has reduced course con- 
tent by 30 percent (Tobias 1992). A plan now being imple- 
mented in British universities to improve the competencies 
of physics graduates will cut “the content of physics de- 
grees by at least two-thirds. ‘If we aimed to teach less, we 
could teach far better'" ("English Physics" 1990). 

Disciplining ourselves to prune away forgettable and for- 
gotten content and focus on the most important knowl- 
edge, skills, and values can lead to learning so deeply 
embedded it cannot easily be lost. 

Mastery learning: Reaching high expectations 

Rather than accepting most students' low-quality learning 
semester after semester, mastery learning emphasizes high- 
quality achievement on the part of all students (Block 1971; 
Bloom 1976; Guskey 1988; Kulik, Kulik, and Bangeit- 
Drowns 1990; Levine and Associates 1985). Mastery learn- 
ing eliminates time as the independent variable in learning 
and replaces it with mastery of specific, preidentified 
knowledge and skills, allowing variable amounts of time 
according to the needs of individual learners and thus 
removing a major barrier to success. The focus ot mastery 
learning is on results, not time spent. 

Integrated systems of instruction 

Powerful instructional systems that specifically use the 
results of empirical research on learning have been devel- 
oped to achieve higher education’s important aims. The 
superiority of these systems to conventional instruction is 
supported by numerous studies. These overarching instaic 
tional frameworks systemically link together principles ot 
good educational practice. 
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dence on the written word, students’ active involvement in 
learning at every point, self-pacing to accommodate widely 
differing rates of learning, insistence on mastery of a sub- 
ject, use of student “proctors" or peer tutors, frequent con- 
tact between students, and timely and nonpunitive assess- 
ment and feedback (Guskey 1988; Keller 1968; Keller and 
Sherman 1974; Reboy and Semb 1991; Ruskin 1976). In a 
PSl course, the instmctor serves as a manager of learning 
rather than primarily as a transmitter of information through 
lectures. The instructor specifies the outcomes of the 
course through learning objectives, sets the standards of 
masteiy, and evaluates, selects, and develops instructional 
materials. PSI depends on the written word. All students 
are assumed capable of high achievement, and mastery is 
required of all. They are given considerable responsibility 
for their own learning as well as freedom to achieve the 
course objectives at their own rate and methods, and at 
times and in places of their own choice. Students progress 
through the course in a carefully predetermined sequence, 
achieving the objectives of each unit before being permit-' 
ted to proceed to the next. Students who do not achieve 
“mastery” on a unit test restudy until they can demon- 
strate their understanding and skills at that level on addi- 
tional tests. 

More advanced studen: (proctors), in a ratio of about 
one proctor to 10 students, help students learn by adminis- 
tering, scoring, and recording tests and discussing course 
material with them. They also provide valuable feedback to 
the instmctor on all aspects of students’ progress and 
course functioning. 

PSI courses can include textbooks, laboratory work, dis- 
cussions, and other traditional methods. Lectures, however 
are few in nimber, short, of relatively minor significance, ’ 
optional foi students, and reserved primarily for motiva- 
tional purpo.ses rather then the transmission of information. 

Cooperative learning. “The best thing colleges could do 
lor students in coming years would be to train them how 
to engage in group efforts productively" (Light I990, p ’’I) 
“Few students, if any, have these skills when they an-ive at 
college. Fewer still ever get formal training in them" (p, 

71). The complex of methods collectively known as “co- 
operative learning" (CL) is a highly flexible and variable 
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group of instructional procedures that can involve students 
actively in learning, provide extensive contact between and 
among students, specifically teach interpersonal and team 
skills, help students learn personal responsibility to others, 
and be used to achieve almost any desired cognitive, affec- 
tive, or motor learning outcome in any discipline (Bouton 
and Garth 1983; Cooper et al. 1990; Johnson, Johnson, and 
Smith 1991a, 1991b; Kagan 1989; Michaelsen 1992; Millis 
1991; Winston et al. 1988). CL has been used widely at all 
levels of schooling and has substantial empirical support 
for its effectiveness. The methods used in CL can be linked 
to form a coordinated instruaional system or used with 
both traditional methods or other research-based methods, 
such as group problem solving with Guided Design (Wales 
and Stager 1977; White and Coscarelli 1986). Widespread, 
effective use of CL methods throughout higher education 
could lead to major gains in the development of students 
of almost every kind. 

The use of CL has dramatically improved class atten- 
dance — with absenteeism dropping from 50 percent to 1 
percent in one study — and has had strong positive effects 
on students’ self-esteem, relations among members of dif- 
ferent races, and cooperativeness in other situations (Bon- 
well and Eison 1991). CL could have especially powerful 
effects in achieving the major paradigm shifts that charac- 
terize development of abstract thinking, epistemology, and 
principled ethical reasoning. These types of development 
may be better facilitated by interaction among peers, who 
in most cases are closer to each other in developmental 
level than faculty. CL can also significantly increase contact 
of various sorts between students and faculty. 

Leartiing communities 

Across the country teachers and students are developing 
communities that are involved in collaborative learning in 
courses, programs, academic departments, and residence 
halls (Gabelnick et al. 1990; Schroeder 1994; Wilcox and 
Ebbs 1992), perhaps most notably through the Washington 
Center for Improving the Quality of Undergraduate Educa- 
tion (Washington 1994). Such learning communities bring 
everyone involved together in a joint quest for learning. 

A psychological climate can be developed tliat brings to- 
gether students different in experience, etlinicity, religion, 
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and other characteristics and permits them to learn from 
each other intensively and cooperatively. Learning commu- 
nities can help integrate fragmented curricula, build social 
and team skills, reduce students’ boredom and attrition 
from courses and institutions, and validate the worth of 
each as a person and learner. 

5. Campus Climate: Beginning in the Classroom 

Most students have their most sustained contact with offi- 
cial representatives of their institutions in the classroom. 
Although development and management of a campus cli- 
mate requires many specific actions, the classroom — the 
individual teacher — is centnil; “It is in the classroom where 
community begins. . (Boyer 1990a, p. l6). Although 
important for all students, community on campus is espe- 
cially critical lor the “new" students: women, minority- 
group students, older students, and commuters. 

It 's in the classroom where social and intellectual bonding 
is most likely to occur For commuter students this is the 
primary point of campus contact. . . . The classroom can 
be an oasis of social and emotional support in the often 
hectic lives of older students (Boyer 1990a, p. 53). 

Cooperati\'e learning and learning communities are po%\ er- 
ful methods for staicturing just this sort of supportive, vali- 
dating learning environment in virtually every' course. >X’ell- 
designed instruction can set the psychological tone across 
the entire curriculum and campus. 

6. Learning to Learn: Strategies that Work 

The ho '.rs students reported studying per week, in Astin s 
1993 study, were significantly correlated with over two- 
thirds of his 82 student outcome variables, including virtu- 
ally all academic outcomes. Hours spent in class per week 
were correlated with far fewer outcomes. Students who use 
effective learning strategies lend to be retained on campus; 
those who do not lend to withdraw. The effort put forth by 
students is possibly the most important factor in their 
de\elopment. According to the research reviewed earlier, 
most students do not study nearly enough for effective 
learn in^^ in college. Students learn what they study, and it 
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is important that they understand just how much they need 
to study. But effon from students is not enough; quality of 
effort is what counts. 

Today, much is known about how students learn (see, 
e.g., Schmeck 1988; Weinstein 1988b). Most students do not 
learn effective study methods by themselves or use them to 
good effect (McKeachie et al. 1990). Many students routinely 
use methods for learning that are well known not to work, 
such as repeatedly rereading their textbooks; as long ago 
as 1917, this method was shown to be far inferior to recit- 
ing the material being learned (Gates, cited by Brethowcr 
1977). Students need to be diiectly taught specific methods of 
learning and metacognition (McKeachie et al. 1990). Re- 
search shows formal instruction in effective learning strat- 
egies can help students achieve significantly greater learn- 
ing (Dansereau 1985; Davies 1983: McKeachie et al. 1990; 
Weinstein 1988a), yet despite urgings for us to teach our 
students how to be skilled and avid lifelong learners, able 
to improve their own intelligence, very few students have 
ever been taught how to learn, either in high school or in 
college. Of 745 Rutgers University undergraduates surv'cyed 
informally, for example, only 14.1 percent claimed ever to 
have been taught how' to study. By withholding this essen- 
tial information from our students, we are in many cases 
foreclosing them from success and from the pleasure of 
learning in college and perhaps throughout their lives. 

The attendant toll for society is enormous. 

If we are to enable our students to be effective learners 
both in college and beyond, to engage in deep rather than 
“surface” learning (“Deep Learning” 1993), we should sys- 
tematically ensure that every' person becomes skilled at 
learning. This one act on our pan could alone dramatically 
improve students’ — and therefore our owm — learning pro- 
ductivity while transforming the college experience for 
many thousands of students. Using tools like the LASSI. H- 
LASSI (Weinstein, Palmer, and Schulte 1987), and MSLQ 
(Pintrich and Johnson 1990; Pintrich et al. 1991) to as.sess 
learning skills can help systematically diagnose the learning 
skills students need to develop. Other resources can help 
us teach them how to learn effectively, enjoy learning, and 
be successful at it (Johnson et al. 1991; Sherman 1985: 
Weinstein 1988a. 1988b; Weinstein and Mayer 1986; 
Weiastein and Underworld 1985). 
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7* Developmental Academic Advising: Building 
Supportive Relationships 

Academic and personal guidance, advising, and counseling 
appropriate to each person throughout his or her college 
years are well established as vitally imponant for students’ 
development and institutions’ educational success. Equally 
well known is the generally poor quality — or even com- 
plete lack — of academic advising on most campuses. The 
resulting confusion and developmental loss for students, 
frustration and disappointment for faculty and staff, and 
financial loss to colleges and universities because of 
students’ attrition are significant. And despite the well- 
established central importance for development of contact 
between students and faculty outside class, Pascarella and 
Terenzini (1991) concluded from their review of research 
that interaction between students and faculty in many insti- 
tutions is generally limited to “fomialized, somewhat stmc- 
tured situations, such as the lecture, laboratory, or discus- 
sion sectiorx" (p. 393). 

The concept of developmental academic advising is an 
overarching, r?search-supponed concept that systematically 
links various advising and counseling efforts now typically 
disjunct and scattered across campus (Brown and DeCoster 
1982; Crooksron 1972; Gordon 1992, 1994; King 1993; 
Winston, Ender, and Miller 1982; Winston, Miller, el al. 

?984). Responding to the needs of each student, develop- 
menia' academic advising provides thorough assessment of 
a student’s characteristics and feedback, guidance, and 
mentoring from trained advisers throughout college. 

Rather than being a frill peripheral to the real educational 
enterprise of classroom teaching and a drain on more im- 
portant work, high-quality academic advising can be one of 
the most piiident investments an institution can make, par- 
ticularly in a time of fiscal austerity. “Probably the single 
most important move an institution can make to increase 
persistence to graduation is to ensure that students receive 
the guidance they need at the beginning of the journey 
through college to graduation” (Forrest 1985, p. 74). And 
high-quality developmental advising need not require a 
major increase in fiscal resources (Hines 1984). Even for 
public iastitutions, where tuition is relatively low, "if effec- 
tive academic advising is associated w'ith higher retention 
rates, the tuition revenue alone will compensate for the 
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institution’s investment in academic advising as a sepa- 
rate and distinct budget item” (p. 340). The cost of qual- 
ity is zero. 



Conclusions 

This section has focused on only a handful of basic actions 
we can and should take to transform our institutions and 
achieve the very large gains in students’ learning and de- 
velopment society require? . We can do many more things 
to improve the quality of our results, and the resources 
cited throughout this mon :>graph can point the way. 

We need to act with dispatch. Higher education often 
takes twice as long to adopt innovations as industry' 
(Siegfried, Getz, and Anderson 1995). Society' cannot wait 
for us; w'e need to act now. 
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PRODUCING RESULTS; leadership for Quality 



This review of the research on sludeni development in 
colleges and universities has revealed numerous substan- 
tive problems in our educational processes. Twelve years 
of efforts to reform and restructure the schools, efforts far 
more vigorous, comprehensive, and sustained than those 
so far applied to higher education, have led to success 
only in a limited number of schools and districts (“From 
Risk” 1993). How can we in higher education act in a 
more effective and timely way to improve the quality of 
postsecondary education? 




We need a 
new way of 
leading and 
managing our 
enterprise. 



Managing for Quality 

Just as research has clarified the process of student devel- 
opment . self, it has illuminated the functioning of our com- 
plex academic organizations, and methods exist today for 
managing our educational work systematically and systemi- 
cally. We have been using the relatively laissez-faire meth- 
ods of the past, however, which have often lacked clear 
goals and objectives; regular monitoring of entering stu- 
dents’ characteristics, outcomes produced, or educational 
processes used; and systematic coordination and links 
among units. These methods have permitted educational 
activities — curricula, instruction, advising, assessment, gen- 
eral education, the disciplinaiy majors — eac'h to run along 
on its own track. As has been so clearly shown by the 
research surveyed in this monograph, our educational 
processes are all too often incoherent and fragmented; 
efforts are unfocused and ttius fail to achieve the synergy 
required to produce the complex, high-quality develop- 
mental results we want and society requires. We need a 
new way of leading and managing our enterprise. 

Continuous Quality Improvement is a powerful synthetic 
method that can integrate these efforts systematically and 
comprehensively, consistently focusing on the quality of 
both processes and results (Crosby 1979; Deming 1986; 
Juran 1988, 1989; Walton 1986). Where it has been used, 
quality improvement has often led to dramatic increases in 
morale, more efficient use of resources, and higher-quality 
results. The widespread application of the philosophy an^.’ 
methods of quality improvement in Japan after World War 
II is credited with transforming that nations war-weakened 
industry into the highly effective international economic 
powerhouse of today. 
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Principles and methods of quality improvement are now 
being successfully adapted to the needs and culture of col- 
leges and universities (Chaffee and Sherr 1992; Cornesky 
and Associates 1990; Cornesky and McCool 1992; Cornesky 
et al. 1991; Harris, Hillenmeyer, and Foran 1989; Marchese 
1991b, 1993; North Dakota n.d.; Seymour 1991, 1992; 
Seymour and Collett 1991; Sherr and Teeter 1991). Quality 
improvement focuses everyone’s attention — faculty mem- 
bers, administrators, staff, students, trustees — on improving 
quality at every point; everyone is involved. A continuous, 
never-ending effort is made to improve the quality of out- 
comes by improving the quality of the educational process 
at every point along the way by identifying, understanding, 
and eliminating problems that reduce quality. 

Using Research to Improve Quality 

The professional literature in higher education 

In a very real sense, ours is an amateur industry. Although 
our primary mission is almost always education, we our- 
selves have traditionally been well trained for neither class- 
room nor administrative office. What is perhaps even more 
surprising, however, is our common unwillingness to 
employ in our own affairs those appreciable skills we do 
possess, those of scholarship and research. As long as two 
decades ago, Chickering (1974) noted that “the results of 
social science research are seldom seriously taken into 
account by educational decision makers" (p. xii). More 
recently, the NIE Study Group concurred; “Colleges, com- 
munity colleges, and universities rarely seek and apply this 
knowledge in shaping their educational policies and prac- 
tices" (Study Group 1984, p. 17). Others ask “why the e^’i- 
dence of systematic social science research is rarely brought 
to bear on actual decisions about educational planning or 
goal attainment" (Winter, McClelland, and Stewart 1981, p. 
ix). Quality processes that produce quality results will re- 
quire us not only to produce research but also to use it. 
Institutions that apply research succeed with all their stu- 
dents; those that ignore research can help relatively few. 
"We educators may do w^ell to think more explicitly and 
unsentimentally about our business and try to found it on 
the emerging consensus of scientific evidence" (Walberg 
1984, p. 20); it is time for research to inform and guide 
educational policy and planning. 
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Research on assessment: Understanding our educa- 
tional processes and developing a culture of evidence 

U.S. colleges and universities have increased tremendously 
in complexity since World War II. The huge influx of stu- 
dents, their increasing diversity, the growing number and 
technical complexity of our disciplines and thus the diver- 
sity of departments and programs and of their faculty and 
staff — ^all have profoundly changed the nature of our insti- 
tutions. We need to match this organizational reality with 
newer, more effective, and more productive methods that 
can help us ensure high-quality educational processes and 
high-quality results throughout our institutions. But “con- 
ventional wisdom concerning what constitutes ‘high-quality 
education’ will not be appropriate for most institutions in 
the 1990s” (Bergquist and Armstrong 1986, p. xiv). 

Quality improvement emphasizes clearly defined out- 
comes and institutional research — using continuous assess- 
ment to provide everyone with crucial evidence al.out what 
is happening in the institution. Input assessment provides 
information about important characteristics of entering stu- 
dents, both individually and as a group, such as their 
knowledge, abstract and critical thinking skills, learning 
styles, and levels of epistemological development. Process 
assessment continuously monitors the educational process: 
how programs — orientation, curricula, instruction, advis- 
ing — are functioning. Outcome assessment shows what 
results are being produced. Faculty-conducted classroom 
assessment is a natural part of this effort. 

Traditionally, wc have depended for our judgments of 
quality on quantitative measures of our resources or inputs, 
such as the SAT or ACT scores of entering students, num- 
ber of volumes in the library, percentage of faculty mem- 
bers who hold doctorates, and size of physical plant and 
endowment. Although these types of information are im- 
portant, they paint a far from complete picture of institu- 
tional quality. None tell us how effective we are in using 
these resources to produce results — the desired outcomes — 
and it is the results that count. 

The 1980s brought a national refocusing of attention on 
results: a college or university s intended results as de- 
scribed by its stated outcome goals and objectives and the 
actual resiihs produc ed by the institution’s educational 
proce.sses. Irc^nically, because most of us have only limited 
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information on the results of our work by which to judge 
our true quality, many institutions have come to depend on 
the opinions of writers for popular magazines, "quantified 
gossip as it has been called, to judge their quality com- 
pared to other institutions — in reputation (an input), not 
results (outcomes). 

Of course, specifying and assessing outcomes does not 
tell the whole story. Necessary as it is, assessment of out- 
comes can tell us only what our results are and how much 
ol them we have reached. It cannot tell us why we have 
reached them. We cannot identify the educational processes 
that caused the outcomes or determine w’hether we our- 
selves are even responsible for the results. Perhaps, for 
example, our students possessed the same characteristics 
when they entered, or the outcomes are products of bio- 
logical maturation or off-campus experiences. 

In other words, in addition to knowing both the re- 
sources or inputs provided to an institution and its out- 
comes, we need to devote considerable attention to under- 
■Standing its educational processes. We need to identify’ 
clearly the characteristics theory suggests typify effective 
processes — the experiences our students mu.st have if we 
are to help them achieve imponant outcomes. Then we 
to a.ssess educational proce.sse.s to learn the extent to 
uhich they' possess these essential characteri.stics. 

Ihc cc}itral focus lu defuun^ uficl achieving ^^high cfual- 
liy must he on the educational process!, which! requires 
serious attention to be given to what actually happens to 
promote (and inhibit) the cognitive and affective develop- 
ment of the individual student through the educational 
(Hergcjuist and Armstrong 19«6, p. xiv). 

\Xe need to invest time and energy in applying powerful 
re.srardi methods and findings to the design and manage- 
ment ol our own educational activities. We will now need 
to use this valuable information and what is today consid- 
ered by exj')erts to be accepted profe.ssional j')ractice in a 
much more deliberate and .systematic way' if w'e are to 
achieve the complex develupnienlal outcomes we desire 
for our students and lor the well-being of .society. 
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Adequate Resources: The Cost of Waste 

Our institutions may seem deceptively orderly and busi- 
nesslike on the surface. Students are admitted, classes are 
taught, and commencement ceremonies stir emotions. As 
we have seen when w'e examine our educational processes 
and results with the more powerful lens of research-leased 
principles of modern professional education and manage- 
ment, however, another, less satisfying image of academe 
too often emerges. The research reviewed in this mono- 
graph presents an all-too-consistent picture of an enterprise 
that has not kept pace with developments in education and 
management. Like Rip van Winkle of Sleepy HolUw, we 
have allow^ed the developments of the last two decades in 
our profession to pass us by. As a result, the effectiveness 
of our colleges and universities in aehie\ ing the results 
society urgently needs and the efficiency witli which they 
expend their resources are both generally far lower than 
they can and should be. 

I- very student who withdraws from college unnecessarily 
because of dissatisfaction or avoidable failure induces costs 
beyond those of dreams delayed or development retarded. 
The average cost to students of a degree at a public four- 
year college is more than $40,000 (Goldberg 1993b). Loss 
of this income to the institution is significant, but other 
financial losses accrue as w-ell: (1) annual income lost in 
tuition, room, board, bookstore sales, incidental food, and 
pui chases by visitors to campus, all multiplied by, say, 
three years, as most withdrawals occur during the first year; 
(2) lost gifts from alumni, multiplied by 50 years; and (3) 
the cost of replacing these students with new ones (with 
the average recruitment cost for a single student, according 
to the Admissions Marketing, Group, ranging from about 
$1,700 to as much as $2,400, covering the admission staffs 
time, publications, videos, postage, telephone calls, and 
travel) (Seymour 1992). With many institutions losing one- 
half or more of their students before graduation, a 5 per- 
cent increase in persistence could "[recapture] $750,000 in 
lo.st revenue. Figures like that command attention" (Mar- 
chese, cited by Noel et al. p. 45()). 

We need to be much more concerned than we now are 
about the losses resulting from the attrition ot siutlenls, 
or scrap." 
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And how does the institution respond!^ With quiet indiffer- 
ence. In fact, as long as the aggregate numbers hold up — 
enough newcomets to replace the ones who left — the loss 
usually goes virtually unnoticed. No one takes the time to 
calculate the cost of scrap. No orie seems to care (Seymour 
1992, p. 139). 

With finances in such short supply, we need to calculate 
and vve need to care. Clearly, we can be far more effective 
and efficient. Beyond the practical matters of quality results 
and, for some institutions, survival itself, clear ethical issues 
are involved: our treatment of our student clients and our 
stewardship of our supporters' resources. We need to be 
considerate and responsible; we need to become aware of 
our students. 

Altiiough perhaps more obvious than others, unnecessary' 
withdrawal is just one source of waste on campus. Unin- 
voived, unmotivated students, ineffective and inefficient 
curricula and instruction, and mediocre advising all lead to 
additional significant costs beyond vvithdraw’al: taking the 
w rong courses and learning the WTong things, repeating 
courses unnecessarily ("rework"), and that ocean of me- 
diocre learning signified by ubiquitous C and D — but “pas.s- 
— grades. Hach inefficiency can be tiiought of as ha\ ing 
a concrete dollar value now and in the future to both stu- 
dents and institutions, and each is a form of w'aste. 

Business organizations ca i waste fully 15 to 20 percent 
of sales income by "doing things wrong . . . w ithout even 
trv'ing,” as "a result of not doing things right the first time" 
(Crosby 1979, p. 15). Quality experts assert the cost of 
waste in manufacturing organizations can be 25 to 30 per- 
cent of income and as high as 40 percent in serv’ice organi- 
zati()ns like colleges and universities (Cornesky et al. 1901. 
PP 13, 35; Seymour 1993b). With only about 50 percent of 
all students w ho intend to earn degrees graduating (Stu<.ly 
(jroup 1984) and the greater than 50 percent rate of stu- 
dents withdrawal in many institutions, the real w’aste of 
resources is substantial from doing things wTong and hav - 
ing to redo them — or simply discarding the results. In our 
concern with fiscal solvency, w’c have allowed "educational 
solvency . . . t<^ drift" (Cro.ss 19«(). p. 10). Beyond its obvi- 
ous central importance to our mission, educational solvency 
also has enormous fiscal implications. 
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A well-ain business organization "can get by with (a cost 
of] less than 2.5 percent of sales” (Crosby 1979, p. 15), 
which, rather than being wasted, is invested in preventing 
waste and monitoring to ensure high quality, The American 
Society for Training and Development has estimated that, 
each year, businesses must expend no less than 2 percent 
of their payroll on professional development training to be 
competitive internationally (Howard yi.d.). Some well- 
managed companies spend as much as 5 c>r o percent of 
salaries on training, Baldiige National Quality Award win- 
ner Motorola calculates a 30-to-l return on training expen- 
ditures (Marchese 1993). What would we learn about our 
colleges and universities, and what would be the effect 
on quality, if we were to invest 2 to 2.5 percent of our 
education- related budgets, a small fraction of our waste, on 
assessment and training and then use the results c;f this 
research deliberately and systematically to imprcne quality 
and productivity by doing things right the first time? 

W. Kdvvards Deming, a long-time professor at New ’^’ork 
University and centrally influential in Japan’s postwar eco- 
nomic resurgence, noted that we need to monitor quality: 

If an ybody needs quality control, it 's the service industhes, 
including universities. College presidents, like most execu- 
tives, fail to see that improving quality is their main busi- 
ness. We re in a neiv economic era. Quality is the key 
to higher productivity, because approximately 20 per- 
cent of the cost of things, from automobiles to college edu- 
cations, is a charge for uaste {Denwng,, cited in Keller 
1983, p. 136). 

Our Standards: Setting High 
Expectations for Ourselves 

If we arc to achieve high-quality outcomes, we need to 
have high expectations, not only for our students but also 
for ourselves, and we must be w illing to change. * It’s not 
the case that American higher education lacks all standards. 
The problem is that the standards we deploy are often not 
notably high, evenly applied, or much discussed; they are 
various, idiosyncratic, and private — to outsiders they look 
like cheese" (Marchese 1991a, p. i). The expectations oth 
ers now have for us — clearly defined goals for outccjmes 
and regular assessment of results, the maintenance t)f high 
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public standards, the continuous use of research to 
prove our educational processes — “contravene a centuiy’s 
way of doing things in American universities” (Marchese 
1991a, p. 4), 

Consider the academic culture that characterizes many 
institutions. The culture of the academic department, where 
students and faculty interact, is often observed to be hostile 
to students and learning. Based cm interviews with 300 fac- 
ulty members at 20 diverse colleges and universities, re- 
searchers observed widespread isolation of faculty from 
their colleagues, a “veneer of civility," lack of common pur- 
pose and effort to solve educational problems, and primary 
emphasis on disciplinary' research coupled w'ith neglect of 
teaching with respect to serious evaluation, salary, and pro- 
motions (Massey, Wilger, and Colbeck 199*^). 

Blaming our students (our paying clients) for not know- 
ing or caring or studying, blaming the schools (our suppli- 
ers) for sending them to us in what we often believe is an 
undereducated condition, and blaming our sponsors (also 
our customers) for not giving us more resources cannot 
become excuses to justify inaction on our part. Lack of 
clear mission, vision, values, goals, and knowledge of 
results, and low standards and untrained faculty and staff 
are all our own responsibilities. Our students’ level of 
in\‘ol\ ement or quality of effort may ultimately be most 
important in producing results, but 

. . . o?ie should not conclude that what the college docs is 
of minor influence. . . . It is the college — the administrn- 
tion as well as the professors — that sets the intellectual 
standards, the quality of performance it expects from sui- 
dents, and exemplifies its values by the quality of facilities 
it provides 1984, p. 97). 

Concluding their massive re\ iew' of resea rcli on the de- 
velopment of students in college, Pascarelia and Terenzini 
(1991), call for a “shift in the decision-making orientation ' 
ol administrators toward “learning-centered management 
. that consistently and systematically” focuses on the 
consequences of decisions on students’ development (p. 
65(>). "Modern colleges and especially universities seem 
far better structured to process large numbers of students 
efficiently than to maximize Itheir] learning' (p. 6^16). VCe 



need a new standard of quality, one based on the qual- 
ity of our results in producing student development, 
Pascarella and Terenzini found few durable differences 
among institutions as a whole in the cognitive, psychoso- 
cial, or economic outcomes they produced. Despite large 
differences in size, selectivity, resources, prestige, type of 
governance, or curricular emphasis, large differences in 
outcomes disappeared once students' characteristics upon 
entty were accounted for, 

Ihese findings , . . support Ithel argument that many cur- 
rent notions of institutional quality may be misleading, 
particularly those based on resources ( libra fy holdings, 
endowment, faculty degrees, and so on), simpleminded 
outcomes (such as the quality of an institiitiofi 's graduates 
unadjusted for their precollege characteristics), or reputa- 
tion {Pdsc:ire\Vd and Terenzini 1991. p. 637), 

We often claim very high quality in our public relations 
materials, but the research reviewed here suggests we often 
tolerate a far less exacting performance. Today, quality in 
organizations is often defined as meeting or exceeding cus- 
tomers' needs, Such a standaid invites dramatic changes in 
the way we manage our affairs and promises equally dra- 
matic improvement in the results we produce. 

Being Clear about Purpose: What Business Are We In? 

Effective organizations understand their missions — their 
purposes — clearly. Yei many of us are confused about our 
institutions' missions, VC'hat is our business and what busi- 
ness should we be in? ‘Teaching is in fact the business of 
the business. Teaching is the task that distinguishes col- 
leges and universities, along w ith primary’ and secondary 
schi)ols, from all other serv’ice agen^'ies " (Pew’ 1989, p. 2). 
Judging by the evidence review’ed in this monograph, lu)w - 
ever, W'e are not attending nearly closely enough to our 
central mission, our students* development: who our stu- 
dents are and w hat their needs are, w hat research has 
show n us about how' students develop, what good profes- 
.sional practice is today and how closely our own educa- 
tional processes approximate those practices, what we want 
our results to be and what they actually are 
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Prominent management authority Peter Drucker notes, 
“Most managements, if they ask the question at all, ask 
‘what is our business?’ w'hen the company is in trouble. Of 
course, then it must be asked” (Drucker 1974, p. 86, em- 
phasis in the original). Many commentators today suggest 
that higher education in this country is in trouble. Perhaps 
we should ask what business we are in and what business 
w'c should bG in. Doing so can have great potential value: 
“Then asking the question may, indeed, have spectacular 
results and may even reverse w'hat appears irreversible 
decline” (p. 86). 

Who Owns These Problems? Management’s 
Role of Leadership 

If the finding of research or students’ development in col- 
lege and the considered view's of numerous authorities and 
study groups w'ho have found us wanting are actively used, 
these critiques can play a key role in improving the quality 
of our work. “Institutional change and improvement are 
motivated mc^re by knowledge of problems than by knowl- 
edge of successes: Segal ive feedback is more conducive to 
adva?icement than is positive feedback" iCcuriGron 1984, p. 
71, emphasis added). Although looking back across the 
research reviewed in this mcincigraph is somewhat discour- 
aging, each area of difficulty can with equal justification be 
viewed as an area of opponunity: an opponunity to signifi- 
cantly impro'X' quality. 

Accomplishing missions, setting goals, maintaining stan- 
dards, monitoring quality of process and results, managing 
the organizational culture, rewarding effective work, and 
providing staff development are all responsibilities of man- 
agement. These complex issues and tasks must be deliber- 
ately managed to ensure they are executed effectively, both 
individually and collectively. In higher education, some of 
these functions and elements are responsibilities primarily 
of administrators and faculty. Ultimately, however, the pres- 
ident as chief executive officer must take responsibility for 
accomplishing the mission at a high level of quality. 

Leadership, communication, and 
cooperative teamwork 

An improvement in quality begins with vigorems and sus- 
tained leadership — a relentless “champion.ship” of quality — 
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from the president. Leadership for quality is based on per- 
sonal integrity, dear moral values, and a strong effort to 
build community. It is characterized by open communica- 
tion throughout the in‘=titution — sharing of information and 
power, cooperation rather than competition among people 
and departments, teamwork rather than isolation, vigorous 
identification and removal of barriers to pride in workman- 
ship, the elimination of fear, and accordance of respect and 
consideration to everyone (Bennis 1989; Birnbaum 1992; 
Bogue 1994; Burns 1978; Deming 1986; Guskin and Bassis 
1985; McLaughlin and Riesman 1990). Administrators, fac- 
ulty members, nonacademic staff, and students all become 
partners rather than isolates or adversaries. 

The “85-15 rule” 

Experience in organizations of many types has demonstrated 
that most of the problems discussed in this monograph 
are beyond the control of individual members of the faculty 
or .staff; they reside in the organizational system — the aca- 
demic department, the college, the university as a whole. 

As such, these problems ' belong’’ to management rather 
than faculty and staff members as individuals. An enormous 
85 percent oi even more of potentially waste-generating 
institutional problems are of this sort (Cornesky et al. 1991; 
Crosby 1979; Deming 1986; Seymour 1992). ‘'The 85-15 rule 
. . . states that 85 percent of what goes wrong lies within 
the system, and only 15 percent lies with the individual” 
(Seymour 1992, pp. 85-86). Managers own systems; they 
themselves mii.st first provide the leadership and commit- 
ment to quality if the needed change in quality is to occur, 
“Since we assume that administrators control 85 to 90 per- 
cent of the processes and systems, we are convinced that if 
they seriously commit to quality, they can influence faculty 
and students to do likewise” (Cornesky et al. 1991, p. 56) 
Quality management of this .sort will require the be.st- 
trained manager-leaders as well as the best-trained faculty 
and .staff. 

The management of the nun business, piiblic-sctvice insti- 
tutions will indeed be a growing concern from now on. 
Their management may well become the central manage- 
ment problem — simply because the lack of management of 
the public-service institution Ls such a glaring weakness. 




Leadi'rship 
for quality is 
based on 
personal 
integrity, 
clear moral 
values, and a 
strong effort 
to build 
community. 
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whether miniicipal water department or public imivemty 
(Drucker 1974, p. 8). 



Collectively, colleges and universities “constitute one of the 
largest industries in the nation but are among the least 
businesslike and well-managed of all organizations" (Keller 
1983, p. 5). If we • to meet fie needs of our many 
clients — students, parents, employers, state, and nation — we 
will have to be considerably more attentive to managing 
our affairs than we have been, more businesslike in the 
best, most positive sense. 

Professional Development: Prerequisite of Quality 

Quality impro\'ement strongly emphasizes professional 
training and education of faculty and staff; eveiy'one is 
thoroughly trained for his or her work. As the work or con- 
ditions of the work change, high-quality, effect ive profes- 
sional development training and retraining are provided 
automatically and continuously. Perhaps this training aspect 
of nualily is most relevant here. The studies reviewed ear- 
lier suggest we in the academy can dramatically improN’e 
students’ development by adopting newer, more empirically 
grounded and effective educational methods. But every one 
of the several powerful, modern methods recommended 
here, such as systematic instmctional design, cooperative 
learning, and developmental academic advising, requires 
for its effective use the mastery’ of a body of professional 
knowledge and the development of new and complex 
skills. More complex methods are required to produce 
today’s more complex outcomes. The telling of know’l- 
edge — lectures — known to instructors is inadequate. Used 
unski llfully, however, the new methods cannot perform 
effectively. Developing effective statements of intended out- 
comes, designing valid and reliable assessments of actual 
outcomes for both courses and curricula, leading discus- 
sions, advising, and managing complex instructional sys- 
tems are all intellectual, social, emotional, and moral chal- 
lenges that require considerable professional knowledge 
and skill. A significant improvement in the quality of higher 
education will require a major investment in the develop- 
ment of institutions’ human resources. 




Management Development; Enhancing Leadership 

Existing research-based professional methods in both edu- 
cation and management can enable us to create unparal- 
leled high-quality learning on campus. While “we know 
enough to revolutionize education if the knowledge were 
applied to the im.provement of education” (Breihower 1977. 
p. 18), the problem is that, on the whole, we in academe 
are unfamiliar with these methods; we have in most cases 
studied neir*"'^r education nor management. A number of 
barriers impede our insMtut ions’ success. Among our press- 
ing needs are articulation of clearer missions and visions 
of the future, the definition of outcomes, and comprehen- 
sive assessment throughout the institution. Effecting these 
changes and producing results w ill first require more effec- 
tive leadership at all levels and deliberate management of 
key organizational processes. “Leadership is accountable for 
results” (Druckcr 1990, p. 47), and leadership is the respon- 
sibility of management (Deming 1986). 

Two cultures on campus? 

To what extent do academic managers communicate with 
and understand their subordinates? Most of the presidents 
in one study “portrayed themselves as listeners who were 
open to influence. But the perceptions of their constituents 
were often quite different" (Birnbaum 1992. p. 176). The 
campus environment administrators perceive as rational 
and orderly is one in which the faculty believe they must 
‘'scheme" and “compete” to acquire necessary resources 
(Neumann 1992). A study of 23.302 faculty members and 
administrators at 47 universities found a striking gap in per- 
ception betw'een academic administrators and faculty with 
respect to the proper balance between teaching and re- 
search (Gray, Froh, and Diamond 1992). Although adminis- 
trators as a group strongly favored an empliasis on tcach^ 
ing, their faculty perceived unit heads, deans, and central 
administrators as favoring research over teaching. Anoilier 
national surv'ey found consistent and striking gaps [between 
the perceptions (bf \ presidents and (bther administrators 
and 2. “^30 members cbf their cbwn faculties in characteristics 
valued in faculty members and degree of faculty influence 
in their departments (Blackburn and Lawrence ;/ c/.). Al- 
though the facult>’ agreed administratcbrs valued research 
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skills, beyond this point their “responses seem a bit cynical: 
the valued faculty member . . . may be an ‘operator who 
may not be an excellent teacher. . . . Faculty feel relatively 
impotent in their ability to influence certain kindjj of deci- 
sions and to control their work environment” (p. 14). 
“Surprisingly high levels of job stress” exist in academe 
(Seldin 1987, p. 13). In one study, 62 percent of 2,000 fac- 
ulty at 17 colleges claimed “severe” or “moderate” stress 
associated with their work, and in another, 1,900 faculty at 
80 public and independent universities claimed 60 percent 
of daily stress was job related (Seldin 1987). 

Among other common causes cited for faculty burnout, 
now' “one of the most pressing problems facing academe” 
(Armour et al. 1987, p. 4), are perceived lack of control over 
their work, inadi^quate psychic rewards for their efforts, lack 
of community on campus, and lack of creative leadership in 
their institutions. The quality of the institutional psychologi- 
cal climate is the key to developing maximum vitality and 
productivity among faculty, particularly sciiior faculty. 

Some suggest that two cultures exist on campus, admini.s- 
t native and faculty, and that such different perceptions of the 
climate on campus are unlikely to improve the quality of the 
faculty’s performance (Blackburn and Lawrence n.d^. The 
same research also reveals faculty’s considerable lack of trust 
that administrators will act in good faith to better their iasti- 
tutions and a belief that resources are inequitably distributed 
within the institution. (Administrators share the latter belief, 
although to a lesser extent.) 

A further concern relates to administrators' understanding 
of the core student development processes they manage. For 
example, administrators “believe that competition improves 
students’ learning” (Blackburn and Lawrence * d., p. 14). a 
misconception inconsistent w’ith research and expert opin- 
ion. Most of these managers had had experience as faculty 
and presumably were trained in ways similar to other fac- 
ulty, although 30 percent of them claimed their highest de- 
gree was in education. 

The need for training 

Other indicators also suggest we need to improve our lead- 
ership and management of education. About two-fifths (.39 
percent) of respondents to one survey of faculty disagre<*d 
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that their institutions were managed effectively (Boyer 
1989). In addition, 36 percent rated their administration as 
excellent or good, 64 percent as fair or poor. Fully 69 per- 
cent stated that the administration of their institution was 
autocratic — 30 percent ver>^ autocratic — and 44 percent 
found their jobs to be a source of considerable personal 
strain. In another survey of faculty at 392 institutions, only 
11.9 percent of respondents said their administrations were 
open about their policies {Chroiiicle 1994). Everyone needs 
to know skilled, devoted work in support of the institution s 
central mission of students’ development is appreciated and 
rewarded, yet a paltry 9-8 percent of respondents believed 
faculty were rewarded for being good teachers on their 
campuses. Today, just as faculty require a high level of pro- 
fessional knowledge and skill for facilitating students’ 
development, so too do those who lead and manage our 
complex institutions require the highest-quality training for 
this demanding w'ork. 

Among the barriers to effective management in colleges 
and universities is our lack of training for complex and im- 
portant tasks beyond our disciplines (Kells 1988). Well 
trained in their disciplinary' specialties, faculty are frequently 

. . . asked to perform in other areas for which they have 
little or no traming. They are exceptionally good examples 
of "Peter Principled" professionals. . . . Tloe good biologist 
may become a good teacher or researcher, but he/she may 
not be able to run a department or an agency if little or 
710 training is provided for the job*' (Kells 1988, p. 6, 
emphasis in the original). 

The picture of disorganized — even anarchic or chaotic — 
organizations that often emerges from the research on col- 
leges and universities reviewed here surely reflects the 
level of our knowledge and management skills. 

Those among us who hold management responsibilities, 
whether faculty, staff members, or administrators, require 
professional knowledge and skill for tasks like working 
with missions, strategy, and goals and objectives, and 
assessing achievement. They also need to understand stu- 
dent development, modern educational practices, and pro- 
fessional development for staff. They must be able to deal 
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effectively with ever-changing organizational complexity 
and have the knowledge and skills for understanding peo- 
ple and building effective relationships among them. 
Managers need to provide leadership by inspiring a shared 
vision that can energize and win commitment from every'- 
one, develop a supponive climate of unwavering integrity 
and respect for all, build trust, and develop effective teams 
Despite their crucial role in ensuring quality, how’ever, 
managers in higher education, like the faculty, are at best 
unevenly trained for their work. “I know of no institution 
in our society that does a poorer job of educating its ow'n 
employees than higher education" (management professor 
!.awrence Sherr, cited in Seymour 1992, p. 104). Of 377 
senior academic administrators, 47 percent of w'hom were 
chancellors, vice presidents, or provosts, only tw'o-fifths 
claimed to hav'e taken formal college courses in manage- 
ment (Gallagher 1991). Half said they had attended work- 
shops on management. If such experiences are not fol- 
lowed by practice and critical feedback to develop skills, 
however, they are unlikely to lead to long-term changes in 
professional behavior or to have an impact on panicipants’ 
organizations (Levinson-Rose and Menges 1981). Many of 
the major reports of the last decade critical of higher edu- 
cation have stressed the need for far broader and more rig- 
orous programs of faculty' and instmctional development 
than we now^ ha\ e. We need to do as much for those 
among us who manage education. 



The academic depanment chair 

Academic departments constitute the core of a college or 
university. The department "is regarded, quite properly, as 
the primary' agent for maintaining and improving the qual- 
ity and productivity of undergraduate education" (Consor- 
tium for Policy Research in Education, cited in Goldberg 
1993a, p. l6). The academic department chair therefore 
plays a key, frontline leadership role in ensuring high- 
quality educational processes and outcomes. Like other 
members of the faculty, however, department chairs are 
rarely trained for their complex and den.anding tasks. They 
nl'icn lack the essential know'ledge and skills they need 
concerning organizations, education, and people to per- 
form their roles effectively. For example, of over 4,000 aca- 
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demic department chairs, only about one-quarter reported 
being “very successful” or “successful” in motivating poor 
teachers or alienated or burned out tenured members of 
the faculty to De more effective.* 

Detailed interviews with new faculty and administrators 
in one research university found a striking gap between 
department chairs’ perceptions of the quality of support 
they provided for their new professors and the perceptions 
of the faculty themselves (Whitt 1991). The chairs used 
adjectives like “exciting," “challenging,” and "nonthreaten- 
ing” to describe the faculty experience in their departments; 
the faculty used “confusion, anxiety, isolation, and lack of 
support” (p. 193). We need to do better, and help is avail- 
able (sec, e.g., Bennett and Figuli 1990; Booth 1982; Lucas 
1989, 1994; McDade 1987; Tucker 1992). 

Faculty Development: Foundation for 
Student Development 

The range of knowledge and skills required of us today if 
w'e are to educate all our students is substantial. The mod- 
ern philosophy of quality improvement emphasizes thor- 
ough professional development for everybody in prepara- 
tion for each role they will assume and continuous high- 
quality training throughout their careers. How well do we 
now prepare the professoriat for its complex and demand- 
ing educational w'ork? 

Large universities produce almost ail new members of 
the professoriat. Seventy-five percent or more of the grad- 
uate students in some disciplines intend to teach in higher 
education (Diamond and Wilbur 1990), and these graduate 
students often serve as teaching assistants w'hile they 
study. Research conducted during the last decade on uni- 
versities’ efforts to prepare their graduate students to teach 
shows consistently that these programs (1) are ordinarily 
voluntary (Weimer, Svinicki, and Bauer 1989); (2) reach a 
minority of graduate student teachers (Bewman, Loyna- 
chan, and Schafer 1986; Chism 1991; Diamond and Wilbur 
1990; Fink 1985; Ford 1991; Stanley and Chism 1991); (3) 
are usually limited to a few workshop .sessions rather than 
constituting a sy.stematic, sustained, and demanding profes- 
sional curriculum (Chism 1991; Ford 1991; Parrett 1987); 
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and (4) in most cases, provide little or no supervision 
either by experts in learning and teaching or senior mem 
bers of the disciplinary' faculty' (Chism 1991; Diamond and 
Wilbur 1990, Tord 1991, McQuade 1989). In some cases, 
senior faculty actively discourage their students from pailic- 
ipating in this training (Diamond and Wilbur 1990). 
According to former Stanford University President Donald 
Kennedy, faculty development efforts "encounter quiet 
opposition in many departmental locations, where graduate 
students are told that teaching doesn’t really matter — at 
least not in comparison with research” (Kennedy 1995, p 
13) When formal courses are available to novice teachers, 
what do they learn? The primary' instructional nv’thod 
taught is the lecture (Parrett 1987). 

When graduate students finally earn their degrees and 
assume their first faculty positions, many of them never 
having taught or having taught but without any significant 
training as educators, rather than the careful nurturing they 
now require from their institutions and new senior faculty 
colleagues, they are more likely than not to find themselves 
abandoned, left to their own devices as educators (Boice 
1991a, 1992; Fink 1984, Sands, Parson, and Duane 1991; 
Whitt 1991) Once again, some are actively discouraged l>y 
their superiors from participating in training that might take 
time away from their research (Boice 1991a). Not surpris 
ingly, these new teachers more often than not lecture 
"facts-and-principles style” (Boice 1991a, p. 168) and are 
unable ”to stimulate students to high intellectual effort” 
(F'ink 1985, p. 144). On’y 5 to 9 percent of one group of 
new professors were effective, comfortable w'ith their stu- 
dents, and enjoying their work (Boice 1991b). 

The numb ers of other types of part-time teachers, often 
moonlighters with other, full-time careers off campus, 
jumped from 23 percent of all instructors in 1966 to 41 per- 
cent in 1980 (Study Group 1984). Today, about half of all 
teachers in New Jersey public colleges and universities are 
part-timers (Goldberg 1993c). These instructors taught 
about one-third of all course sections in the state. Part- 
timers genercilly receive even less training and supervision 
as educators than graduate TAs (Arden 1995; Gappa and 
Leslie 1993). 

Much is made of the radical changes technology will 
allegedly bring to the “delivery’* of education (Dolence and 
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Norris 1995; Green and Gilbert 1995). Although the Inter- 
net, sophisticated multimedia instructional software, and 
other developments will certainly greatly benefit students' 
learning, the faculty must still understand student develop- 
ment, instructional design, assessment, and ail the other 
modern impedimenta of the profession if they are to use 
technological innovations to good effect in fostering their 
students’ development. 

The single-minded emphasis on research that dominates 
universities and distracts from the faculty’s professional 
development is often justified by the strong salutary impact 
faculty research is alleged to have on the quality of under- 
graduate education. A meta-analysis of 29 studies that 
examined a possible relationship between the quality of 
faculty research and the quality of their teaching, however, 
found the former made a less than 2 percent contrilnilion 
to the latter under the most favorable analytic assumptions 
(Feldman 1987) — an altogether unremarkable finding in 
light of the research reviewed in this monograph (see also 
Webster 1985). The knowledge, skills, values, and disposi- 
tions that underpin creation of knowledge in a specialized 
subdiscipline are usually vcr>' different from those required 
for competence in nurturing human development. 

Clearly, our casual approach to developing and sustain- 
ing our new colleagues — and renewing and upgrading the 
skills of the .senior faculty — must be directly responsible 
for much of the low-quality student experience ponrayed 
by research and the lovv-cjuality educational results many 
of our societal .stakeholders decry. Significant improve- 
ment in the quality of our educational processes and out- 
comes awaits dramatic improvement in the quantity and 
quality of the professional knowledge and skill develop- 
ment we achiewe with each member of our faculties. 

We need to move beyond one-shot, Hash-in-the-pan 
work.shops on this or that toward systemic and systematic 
professional development. I’he last two decades have wit- 
nessed the growth in professional methods for faculty 
development that now pertnit widespread, effective prepa- 
ration of the college and university faculty for their work as 
educators of all students (see, e.g., Hergc[uist and Phillips 



1987; Chism 1987, Diamond 1989; Fble and McKeachie 
198S; I'uhrmann and Grasha 1983; Gaff 19"^5; Katz and 



quality of 
research 
made a less 
than 2 percent 
contribution 
to the quality 
of teaching. 



1975, 1977, 1981; Brookfield 1986, 1987; Brown and Atkins 
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Henry 1988; Lewis 1988, 1993; Lindquist 1978; McKeachie 
1994; Menges and Mathis 1988; Menges and Svinicki 1991; 
Nyquist et al. 1991; Povlacs-Lunde and Healy 1991; 

Prichard and Sawyer 1994; Quinlan 1991; Richlin 1993; 
Svinicki 1990; Wadsworth 1988; Weinier 1990; Wright and 
ONeil 1994). 

Current efforts to reform K-12 education emphasize 
retraining for teachers and principals. "Massive professional 
development” (Price 1993, p. 32) of school teachers is 
needed if national educational reform is to he successful. 
Mow much more needed is a continuous, never-ending 
program of high-quality faculty development in higher edu- 
cation, where traditionally most of us have had no formal 
training whatsoever for tliese complex roles. In our case, 
we have the additional task of helping the current faculty 
dc\elop that base of professional knowledge and skills 
they now require. 

increasingly knowing only a narrow' slice of a research 
specialty, new faculty may ha\e only a rudimentary' grasp 
ol their wider disciplines and have spent little time reflect- 
ing on their philosophical grounding, historical develop- 
ment. and social implications — important contextual foun- 
dations tor any teacher. Alter assuming first faculty 
[X)sition, in many cases isolated even from colleagues within 
their own academic departments, these professors are ill- 
prepared to nurture the broad intellectual, emotional, and 
social development required b> their studciits and sociel\’. 

I rained only in the technical subtleties of literary', historical, 
or .scientih. research and in many ca.ses cloi.stered in 
libraries or laboratories for years during their graduate 
training, they may ne\er have read and reflected on the 
great cLi.ssics of Americ; n liberal education (Bell 1966; 
(a>mmittee on the C.)b|ectives 194^; Hutchins 1936; Newman 
19S9, Van Doren B'‘43) and the histoiy of the American col- 
lege and university, studied the research illuminating their 
students dev elo[:)mental psychology, learned the theory* 
and practice of modern developmental academic advising, 
read the inlluentiiil content [lorary critical refiorts on higher 
education, or studied and practiced under supenision tht* 
design and implc mentation of modern instmetion. Cast 
atlrift i'^ ' profession w ithout ch*m or cxir by their gradu- 
ate SCI. ml mentors and new colleagues and lacking the 
perspective, personal philosophy, and basic educational 
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skills requisite for professional competence, new faculty 
sink or swim in the classroom and advising conference to 
the enormous detriment of their students and society. 

Conclusions 

Using the professional literature as a guide, we have dis- 
covered in each of four core areas crucial to our students’ 
development many opportunities to significantly improve 
the quality of our educational processes and thus the out- 
comes we produce. Understanding the processes as a global, 
systemic whole and skillfully managing them together are 
essential to the organizational success of each, Kvery per- 
son needs to have the knowledge, skills, and climate re- 
quired to perform his or her role at a high level. Manage- 
ment's leadership role is foundation to the entire enterprise: 
achieving widespread commitment to the vision, inducing 
enthusiasm for high standards, maintaining a consistent 
focus on students’ needs, developing teamwork, and 
engendering willingness to challenge old assumptions, 
comfortable habits, and familiar methods. 

An overarching Iramewc^rk for examining cjuality in an 
institution, subunit, or system of institutions is pro\ ided by 
the education criteria for the Malcolm Baldrige National 
Quality' Award ("Kducation Pilot Criteria” 1995). Combining 
the rigorous, professional standards of the criteria with the 
specific research -based education concepts and principles 
reviewed in this monograph can provide powerful guid- 
ance for every’ institution. Used correctly, together they bid 
fair to produce the dramatic improvements in student learn- 
ing promised by the title of this monograph. 
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A CALL TO ACTION; A New Kind of Community 



Today, we in higher education in this country face an 
opportunity unmatched in human history. We are being 
asked to educate all the people and to educate them to a 
very' high level. They are coming to us in greater numbers 
and diversity than ever before. For the first time, we have 
the opportunity to creati\'ely link these vast human re- 
sources with our new knowledge of human and organiza- 
tional development and thus to lead the way to a far more 
developed, mature, and humane society than the world has 
ever known. More fundamental to societal success than the 
broad learning our students should acquire in diverse fields 
of knowledge, how'ever, is their cognitive, ethical, emotional, 
and social development as human beings. We need to help 
them move beyond their relatively simple, concrete, and 
,self-centered orientation to one that is more complex, 
abstract, and prosocial. Recognition is now widespread that 
higher education must change, and, as in other sectors of 
society, repeated and insistent calls have been made for a 
significant, even radical, reinvention, redefinition, and re- 
structuring of our industry' (see, e.g., Guskin 1994a. 1994b; 
Ileydinger 1994; "It’s Time" 1993; Osborne and Gaebler 
1992; “Twice Imagined" 1995). If we u.sc our new research 
based knowledge to construct curricula and courses that 
engage our students' imaginations and activate their ener- 
gies in achiev ing important outcomes — that purposefully 
and consistently involve them in active, social, cooperative 
modes of learning — and if w'e effectively use new dev elop- 
mcnial sty les of advising, our students will surely rise lc3 
heretofore unknown levels of accomplishment. The impact 
on our states and on society more widely, not to mention 
our institutions, could be dramatic. 

Research, theory, and their skilled application arc now- 
essential to high-quality education, but they are not encnigh; 
quality has still another dimension. We need to create on 
campus a climate that inspires and supports high-quality 
effort and respect from everv'one; students, teachers, lead- 
ers alike. We need to create a pervasively moral culture, a 
culture of integrity and of serv ice to our clients. We need "a 
much richer, more complex and paradoxical understanding 
of what happen.s when we teach and learn" (Parker J. 
Palmer, cited in Fdgerton 1992. p. 6). Subjective and objec- 
tive, personal and profe.ssional, emotional and intellectual 
"intertwine, and you can't get people to think w'ell without 
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attention to the feelings that block — and animate — good 
thinking” (p. 6). We need to interact with students and with 
each other in a deeply human way. "A modern college or 
university should be a place where every individual feels 
affirmed and where every activity of the community is 
humane, Caring is the key” (Boyer 1990a, p. 47). 

We need to model for both our students and society 
well-managed and effective organizations: organizations 
that support people who are striving to develop, organi- 
zations whose behavior is richly developmental and 
humane. Yet we have seen that many students and staff 
often perceive our campuses as hostile and alienating. 
“The truth is that academic community has been de- 
stroyed, Universities and many colleges, even small ones, 
are places where faculty do the main business of their 
craft alonel, isolated] from one another and from the pur- 
poses of their institution ” (Gamson 1993. p. 4). The 
cjuality ot our community is key to the quality of our 
results. A barrier to our success is our common inexperi- 
ence in working cooperatively together (Kells 1988). 

Coupevation is relutiivly low. . . . Members are . . . iriexpe- 
hencecl at ivorkinp, together to solve problems. . . . Solving 
complex tasks~the kind ive find all the time at places 
like colleges and uniuetsities — requires flexibility, trust, 
ivarmth, and risk-taking, which are often in short supply 
in these organizations. . . . (For these and other reasons,! 
most groups or committees at postsecondary^ . . , institu- 
tions function very^ badly {KeWs 1988, pp. 5-6). 



Across the country' people are reaching out to each other to 
build community (Htzioni 1993); we should lead the way. 

"A pervasive belief system exists in many colleges and 
universities that questions the importance of values, emo- 
tions, and personal growth and places a premium on cog- 
nitive rationality and intellectual de\’elopment” (Kuh, 
Krehbiel, and MacKay 1988, p. 9). As we strive for objec- 
tivity, our social values and behavior have become com- 
petiti\e and individualistic, our own learning and teaching 
imperst)nal and anticommunal, and vve model this world 
view for our students (Palmer 1987), We should create 
Lani[)us communities in our dep;Mments and courses 
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wliere natural conflict over ideas can be used creatively 
for understanding. 



There is very little conflict in American classrooms, and 
the reason is that the soft virtues of community are lack- 
ing there. . . . \^’hat prevents conflicts in our classrooms is 
fear ... in the heans of teachers as well as students. It is 
fear of exposure, of appearirig ignorant, of being ridiculed 
(Palmer 1987, p. 25). 

Ninety-eight percent of chief student affairs officers in one 
survey believed that “greater effon to build a stronger over- 
all sense of community” was “very important" or “some- 
what important" to improving campus life (Boyer 1990a). 

An analysis of metaphors used in interv’iev^'s with 83 
administrators, faculty members, and department secretaries 
at a large urban state university found that 65 percent of 
the “metaphors expressed some intense emotive ventilation, 
... 75 percent , were negative ... 20 percent were pos- 
itive” (Deshler 1985, p. 22). Many of the metaphors, “an 
emotional barometer of campus culture" (p. 23), expressed 
ho.stility, aggre.ssion, combativeness. The author suggests 
these negative metaphors may reveal; 

. . underlynig positU'^ values that are perceived as being 
fustrated. . . . Wheti viewed this way, one can detect a 
hunger for appreciation and recognition, professional 
survival, a sense of community or shared fate, empathy 
and compassion for others, active participation in gover- 
nance, and academic responsibility. . . . One can hear 
the cry for increased appreciatkm, recognition, dignity, 
and status on the pa^t of faculty members. ... A desire for 
solidarity, unity, collaboration, reconciliation, and inte”- 
dependence can be infemd from many of the metaphon. 

. . . IThese rnetaphofsj refect a longing for increased com- 
munity and shared fate[, and they! can be hiterpreted as 
a refection of empathy or compassion toward others 
(Deshler 1985, pp. 23-2D. 

In visits to numerous campu.ses acrexss the country', 

Parker J. Palmer has observed “‘the pain of di.sconnection,' 
a sense on the part of faculty of being detached from stu- 
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dents, From colleagues, from their own intellectual vocation 
and the passion that originally animated it" (cited in Hdger- 
ton 1992, pp. 5-^). Not only new faculty feel isolated, 
lonely, cut off from communit)’; many of the rest of us 
do as well. 

A concerted plan to construct and maintain a coo{)era- 
tive, considerate, caring, and moral developmental climate, 
in classrooms and elsew'here on campus, will be necessaiy 
to support this vision. For many of us, this new climate of 
community wall require significant changes in the way we 
conduct our affairs. We will need to have an inspiring 
vision of the campus we want to create, and, beginning 
with strong leadership from the top, vve w'ill need to 
involve everyone in making this vision a reality. We need 
to develop a culture of uncompromising ser\ ice to every - 
one, inside and outside our institutions' walls. Fach of us 
w ill have to develop the profe.ssional tools — the new 
know'ledge, skills, and sensitivities — that can enable us to 
transform our vision into actuality. Continuous professional 
development for eveiyone will be an essential underpin- 
ning for the entire endeavor as we seek together to im- 
prove our quality every^where and fore\er. We also need to 
de\elop a collegiality on campus in w’hich vve lake the risk 
of being vulnerable to each other, to expose our .selves, 
and to allow for others’ weaknesses as humans (Bennett 
1991). We need to care more about each other, we need to 
be (onnected to each other in a much more human wav'. 

Our colleges and universities are among the most intlU' 
ential institutions in America and ifoereforc the tvorld. 

“*rhee are few’ institutions in <uir scx'iety', with the excep- 
tion of the family', that have a more powerful impact on 
individual lives and the .society as a whole” (Gamson 19*) 1, 
f). 52). Our graduates till the ranks of leadership in eveiy 
sector: government, the military, busine.ss and industry', 
nonprofit sen ice organizations, and education, at home 
and around the world. The changes we can evoke in our 
students through our own renewal and the changes we can 
evoke in society through them are virtually limitle.ss. 

The perceptions of increasing class division and anti.social 
behav ior in society, a coarsening ot civic discourse, and the 
threat of authoritarianism have produced a concern to 
increase prosocial behavior and significantly enhance com- 







niuniry cveryu'hcre (Htzioni 1993)- Society looks to us for 
leadership. 

Central to dealing with these social challenges is the 
development of the dispositions and skills of critical think- 
ing, master tool for all manner of self-motivated develop- 
ment and personal change and, w'hen coupled with princi- 
pled ethical reasoning, a powerful reparative and develop- 
mental force in society. We need to develop a nation of 
self-aware, enthusiastic, and skilled critical thinkers. 

Society needs us as never before. It needs better trained 
school teachers and principals. It needs technologically 
skilled and ethical professionals in all fields, leaders and 
managers, competent and humane citizens — men and 
women of wisdom — who can interact effectively with oth- 
ers in the workplace and tiie community. Developing them 
is our job. I'he nation al.so needs us to help it [o come 
together in community, to respect others w'ho an diiferent, 
to resolve conllict creatively and nonviolently, to heal its 
divisions. The future of our democratic traditions depends 
on a more mature community that can solve its many prob- 
lems in respectful, nonviolent ways. In addition to teaching 
in our courses specifically how to do tliese things, wx* our- 
selves need to show how to live together peaceably and 
respectfully. 

We know' how to do thc^se things better than e\ er before. 
Many of us believe it is time to act, to seize the moment. 

We can develop new relationships with our students and 
with each other. We can develop and articulate a vision tc)r 
what society' can be. And we can organize our aftairs so 
that we are able to lead the way to the future manifestation 
of the vision, a natk)n that is a tme community, a learning 
society, ci pcn cisiivly clcrcl()f)nicntcil cidtiuv. rhis e.\citing 
prospect can energize us all — stall, students, supporters — in 
a grand cooperathe venture to create our hiture 
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disciplinary re.search, primary emphasis by faculty- as problem, 130 

discussion as mo,st significant learning method, 39 

dishonesty toleration on campus, 71. See also cheating 

“distribution” .system of general education curricula. 26 

diversity, need for appreciation t)f, 8 
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E.ssex County Cc^llege. 51 
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national education, 57-58 
need for clear and rational, 108 
teaching concepts of field as, 3^ 

GPA, question as to meaning of, 65 
grades 
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how' well do they communicate outcomes, 66-68 
predictive validity is severely limited, 67 
graduate courses, difference from undergraduate courses of. 41—15 
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Gardiner, Lion, xi-xii 
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“general learned abilities.” 32 

general learning, counts of credits may not be a reliable proxy of, 
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heuristics, definition and requirement of, 40 
high expectations 

necessary' for quality of education outcomes, 24 
emphasis on, 115 
higher education 

call for significant restructuring of, 107 
many observ ers believe has entered period of great 
change, 3 

Hispanic students. See Latino students 

historically black college and university. See HbCLl 

liistoty, crilicjues of college curricula of, 34 

human C|ualiiies, social and economic future depends upon, 100 
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ideas, most influential interactions focus on, 21 
Impostors in the Tempk\ critique of faculty’-centercd model, xi 
individual consisteiitly outperformed competitive efforts, 20 
Input assessment, 125 

institutional quality, framework for examining, 143 
instruction 

course employment of establi,shed principles of quality. 37 
research-based methods , 113-llH 
instructional 

design, characterization of, 37-38 
objectives for cour^-^s, most faculty still lack formal, 6i 
integrated sys ems of instruction, 1 15 
Integration 

definition of, 74 
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intellectual 

conflict induces cognitive development and moral 
reasoning, 20 

interchange not norma! in a college classroom, 44 
intelligence 

definition of, 9 
influenced by heredity, 9 
intended outcomes, need statements of, 60 
introductory' courses 

lack modes of inquiry characteristic of fields of, 31 
role of, 31 
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Jewish students, experience of elhnoviolence, 81-^2 

jobs requiring education beyond high school, 22% increase in, 1 

John Hopkins University, 100 

journalism, critiques of college curricula of , 34 

K 

Kennedy, Donald. l40 

Kohlberg and Mayer (1972), 108 

Keller plan. See Personalized System of Irustmction 

L 

large classes used recall, 43 

large size, need to reduce effect in education of. 113 

LASSI tool to assess learning skills, 119 

Latino students. See also Mexican- American student.s 

college degrees of 80 % from 20 % of IJ.S. insliiuiions, 84 
graduation rates, 83 

success w'ith cooperative learning, 99-100 
leadership for quality, basis of, 133 
learner-centered model of collegiate education, xi 
learning-centered 

management of administrators need shift to, 130 
models visions of desirable, xi 

learning society, American higher education as gateway to, xi 
learning strategies, need for students to be instructed in, 119 
Learning to Learn, 118-119 
lecture 

behavior similarity of learning and grade oriented 
students, 45 

benefits consistently only the most formal of students, 12 
educational yield low from, 38 

effective as discussion for low-level factual material. 39 
motivational purposes primary’ purpose, Il6 
principal instructional method, 38 
Levin (1991), 96 
liberal arts 

practicality of programs of, 28-29 
students show greater gains in moral judgment. 29 
women’s gender-atypical careers increased by. 28 
libra r>^ low use connected with little time spent in studying, 52 
life-long learning, need for, 7 

listening time. See critical thinking and memorizing 
Louisiana Suite, screening out guns and knives at, 74 
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Malcolm Baldrigc National Quality Award, 143 
Management 

critiques of college curricula of, 34 
Development as enhancement of leadership, 135-139 
role of leadership of, 132-134 
Mastery learning, 115, 96-97 

focus is on results and not time spent, 115 
McMaster University, 51 
medical students. See also pre medicine 

lend not to increase quality of moral rea seining. 29 
medical training, as a multitude of disjointed facts, 45 
medium-sized classes used comprehension, 43 
memorizing 

commonest questions asked by teachers, i3 
listening time positively related to. 4 i 
retention of course material, 46-47 
metacognition 

definition of, 1 1 
self-critical is impossible, 12 
Mexican-American students, higher education failing, S2 
Miami University of Ohio, 14, 69 
Milton (1982), 60, 62, 65 
minority-group students 

life on campus is major cause of withdrawal from college, 
83 

strong coynmUryieul to education and perseverance, 85 
success in mathematics, 98-100 
misconceptions 

held by students, 47-50 

if passive can slip through educational net, 48 

problem of, 47-50 

MIT, use of metal detectors to screen out guns and knives at, 7 i 
monitoring results, need continuously for assessment, 110 
moral development, 15-18 
grades and, 68-71 
of faculty, 71 
components of, 16 
Stages, 17 

moral issues, perception is low of, 69 
MSLQ tool to assess learning skills, 1 19 
Multiplicity 

as second epistemological level, 13 
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defects of, 14 
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A Nation at Risk: Tije Imperative of liclucational Reform, 3 
National Adult Literac 7 Sui-vey. See National Literacy Survey 
National Education Goals, 56-58 
National Literacy Survey, 54, 55 

Native .Americans, SO % receive degrees from 20 % institutions. 



natural science, critiques of college curricula of, 34 
negati\e feedback, conducive to advancement, 132 
New jersey 

Institute for Collegiate Teaching and Learning, xii 
Test of General Intellectual Skills, 5^, 55 
“new" students definition of, 1-2 
NIE Study Group, 53, 12^1. 

on Conditions of Excellence in American Higher 
Education, xi 

Northern Polytechnic University, i6 
Norwich (England) University, 46 
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Oberlin College. 49 
Ohio State University, ^t9 

ortliocloxy, importance of willingne.ss to tjuesiion, 8 
Outcome assessment, 1 25 
outcomes of higher education, data 
moral development, 70-71 
National Literacy Sur\ey, 55 
New Jersey Test of General Intellectual Skills. 5 t 
of courses. 46-50 
problem-solving skills, 50-51, 54 

outcomes should be clearly defined and frequently a.s.se.ssed, 24. 
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Paris, medieval universi^ of, 38 
Pascarella and Terenzini ( 1991). 120-121. 130 

few durable differences among in.slitutions in outcomes. 
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‘■perry Position/’ 14 

Personalized System of Instruction, 115-116 

pen asively developmental cu Iture, 149 

*■ Peter Principled" professionals, educators as, 137 

Piagetian stages of cognitive development, 20 

Piaget, abstract reasoning not possible until about age 11, 10 

post conventional principled ethical reasoning, 19 

pre medicine 

cheating in, 70 

critiques of college curricula of, 34 
president responsibility for filling university mission, 132 
principled ethical reasoning, capacity for, 15-18 
problem solving 

essential to success, 50 
lack of improvement in skills for, 51 
Process assessment, 125 

Frofiicam, critique of faculty-centered model, xi 
professors fill duty then students will not neglect theirs, if, 53 
Project SOAR at Xavier University of Louisiana, 12 
prose literacy, deficiencies in. 54-55 
psychok)gicaI climate 

academic performance association with, 73 
student responsibility for high-quality effort produced by, 
53 

psychological iheoiy, need to use. 111-112 

psychometric work, minimal student guidance with regard to, 65 

psycho pathology' as result of cognitive development, 111 

purpose, need for clarity with regard to. 131-132 

PSI. See Personalized System of Instruction 
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Quality improvement 
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prerequisite of professional development, 134 
c|ualiiy of instruction 

more significant than student's abilities, 97 
teachers perceptions of, 57-59 
quality needs 

a campus climate that inspires and supports. 145 
definition meeting or exceeding customers’ needs, 131 
to monitor. 129 
"(|uantified gossip," 125 
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reading more valuable than listing to lectures, 39 
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definition of knowledge as. 4 1 

level discourse employed by professors in classes , 42 
Reifesi^ning Higher Education, xi-xii, 4-5 
Relativism as epistemological level, 13 
Relativists 

defects of, 14 
few students are, 14 
reliability definition, 63 

required courses, do they have intended eftects, 31-32 
research 

of faculty, effect on quality of teaching is minimal. I ll 
students should be helped to understand and apply. 111 
using to improve quality of education, 124-128 
“rhetoric of conclusions." 59 
Rutgers University', xi. 51, 52. 69. 76 

few undergraduates taught how to study. 119 
knowledge gained at to build World Trade center bomb. 

112 

no Relativists in sample from. 14 

study of first-year physical science students at. 10 

support of author by. xiv 

Teaching Excellence Center Faculty Seminar, xiii 
S 

Saint Cloud State University, faculty making racist comments at, 82 
Samuel Johnson, critique of lectures by. 40 
SAT, college learning assessed through, 32 
Schwab. Joseph, 59 

self-esteem, cooperative activities effect on. 20 

serious learning requires sustained eflort outside the classroom. 51 

Seton Hall University, xii 

skills, tests generally do not assess higher order. 63 

small classes used thinking level of analysis . 43 

Smith, Adam. 53 

Stand and Deliver, 96 

standards, need to be set high. 129-131 

Stanford University, 100. 1 lO 
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stuclem development 

core areas central to the quality- of. -i 
as central mission of university, I 3 I 

people involvement is a most imponant ways of inducing, 
2i 

four key aspects of, 9 
student involvement 

retains them on campus until graduation, 22 
with subject matter critical to learning. 23 
student majority' 

between concrete and h^rmal in their reasoning, 10 
majority failing to graduate at many institutions, 101 
student-centered model, challenge in moving to a, xii 
student-faculty interaction 

correlation s with e\ery academic attainment outcome, 22 
often "formalized, somewhat structured siiuaii(jns”, 

120-121 

students 

amount of work done by, SI -53 
essay generally required knowledge of facts, 62 
experience determined by academic tradition. 105 
assessment of intellectual skills of, 60 
lack of basic laclual knowledge, 47 
new "emerging majority", 2 
perceived inability to educate, 106 
study hours per week significantly correlated w ith outcome, 118 
sul^siantive know^ledge, need for 8 
suicide 

consideration by students of, 75, 75-76 
second cause of death fc^r college students. 76 
su[)ponive 

environment in comprehending and emotional suppon, 23 
relationships, the building of. 120-121 
"surface" learning, 119 
Systematic Assessment, need for, 109-110 
systematic design, need for instaiction through, 113-11 1 

T 

‘1‘axonomy of Eiducational OI)jectives. 11-42, i3, 60-62, 6l 
organizes cognitive beha\ ior into six le\ els. il 
teachers 

as pan-timers, MO 

education college curricula criticjue, 3 l 
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social impact of mciliods in higher education, 50 
talk made up 88.5 % of class time, 44 
teaching melliods, evolution theory as example of prt)hle[n in, 
technical jargon, memory and recitation of, I i 
technology, critiques of college curricula of , 3"t 
Tests, types of, 60-62 

textbook rereading as ineffective learning metlu)d, 119 

theor>' of organic evolution, 48 

thinking 

improvement of higher order, 97-98 
student level higher than profe.ssors, 42 
students active involvement with, 42-^5 
Tinio, Vincent, 74 
Tol^ia.s (1990), 80 

training, need for education leadership and management of 136- 
138 

Trow, Martin, xi 
"taie-core" curriculum 

good effects of, 30 

interdisciplinary characteristic of few institutions, 26 
tutoring teacliing method than conventional group instmction. 96 

U 

U.S. Department of Iailx)r, I 
Uncertainty Principle, 66 

unethical behavior, effect of teaching to recognize and a\'oid. “^3 
University of California, 92 
University of California - Berkeley 

cooperative learning methods and high standards, 99, 100, 
103 

declining percent of students of Oiucasian ancestry , 2 
University of California - Los Angeles, 58, 101 
University' of Chicago survey of minority groups on campus, 81 
University of Illinois, 61, 62 
University of Kansas, 63 
University of Maryland - Baltimore County, 81 
University of Michigan, 58 
University of Nebraska-Lincoln, 12 
University of Idiode Island. 51 
University of Tennessee, 61 
University of Tennessee-Knoxville, 65 
University of Texas-Ausiin. 44, 61 

success with African- American mathematics majors, 9^.) 
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University of Waterloo (Ontario), consideration of suicide at, 75 
UCLA. See Universit>^ of California - Los Angeles 



V 

veterinary piedicme, critiques of college curricula of , 34 
vocationa* y oriented programs and decrement in moral judgment. 



W 

Walberg (1984). 97 

waste-generating problems associated with management, 133 
waste, cost of, 127-129 
“Western University", 27 

students share very little of formal learning at. 30 
white males as a increasingly smaller pan of the w’orkforce, 1 
women 

care-giving in moral issues, 17 
emphasize interpersonal relationships, 17 
increase of number on campus of. 77 
overt sex violence against, 79 
students receive less encouragement than men, 78 
development, peer culture has devastating effect on, 80 
womens libera! ans colleges 

decrease in numbers of, 78 
gender-atypical careers increased by attending, 28 
Workshop 

Physics reduction of course content by 30 %, 115 
low value in professional development of, 138, l4l 
World Trade Center, bon bing of, 112 

X 

Xavier University of Louisiana, 12, 100 
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ASHE-ERIC fflGHER EDUCATION REPORTS 



Since 1983, the Association for the Study of Higher Education 
(ASHE) and the Educational Resources Information Center (ERIC) 
Clearinghouse on Higher Education, a sponsored project of the 
Graduate School of Education and Human Development at The 
George Washington University, have cosponsored the ASHE^ERIC 
Higher Education Report series. The 1994 series is the twenty-third 
overall and the sixth to be published by the School of Education 
and Human Development at the George Washington University. 

Each monograph is the definitive analysis of a tough higher 
education problem, based on thorough research of pertinent liter- 
ature and institutional experiences. Topics are identified by a 
national survey. Noted practitioners and scholars are then com- 
missioned to write the reports, w4th experts providing critical 
reviews of each manuscript before publication. 

Eight monographs (10 before 1985) in the ASHE-ERIC Higher 
Education Reports series are published each year and are avail- 
able on individual and subscription basis. To order, use the order 
form on the 'asi page of this book. 

Qualified persons interested in writing a monograph for the 
ASIIE-ERIC Higher Education Repoits are invited to submit a pro- 
posal to the National Advisory Board. As the preeminent literature 
review and issue analysis series in higher education, we can guar- 
antee wide dissemination and national exposure for accepted can- 
didates. Execution of a monograph requires at least a minimal 
familiarity with the ERIC database, including Resources in 
Education and Current Index to Journals in Education The objec- 
tive of these Reports is to bridge conventional wisdom with prac- 
tical research. Prospective authors are strongly encouraged to call 
Dr. Fife at 800-773-3742. 

For further infi>rmation, write to 
ASHE-ERIC Higher Education Reports 
The George Washington Uni\'ersity 
1 Dupont Circle, Suite 630 
Washington, DC 20036 

Or phone (202) 296-2597, toll-free: 800-773-ERlC 
Write or call for a complete catalog, 
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1. The Advisory Committee Advantage: Creating an 
Effective Strategy for Programmatic Improvement 

Lee Teitel 

2. Collaborative Peer Review: The Role of Faculty in 
Improving College Teaching 

Larry Keig and Michael D, Waggoner 

3 . Prices, Productivity, and Investment: Assessing 
Financial Strategics in Higher Education 
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4. The Development Officer in Higher Education: Toward 
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I ligher Education 
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1993 ASHE-ERIC Higher Education Reports 
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6. Enhancing Promotion, Tenure and Beyond: Faculty 
Socialization as a Cultural Process 

William G. Tierney and Robert A. Rhoads 

7. New Perspectives for Student Affairs Professionals: 
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7. Pursuing Diversity: Recruiting College Minority 
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8. Renewing Civic Capacity: Preparing College Students 
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LION GARDINER is associate professor of zoology at Rutgers 
University. A former co-coordinator of the teaching assistant 
training program of the Graduate School-Newark, he teaches 
a course in effective college teaching for Rutgers graduate 
students and faculty members at New Jersey colleges and 
universities. Dr. Gardiner has developed and led the semes- 
tc ’ -long Faculty Seminar on Students, Learning, and Teaching 
for the campus Teaching Excellence Center, on whose advi- 
sory board he serves, has been a Faculty Fellow in the New 
Jersey Department of Higher Education, and serves as a 
member of the advisory boards of the New Jersey Faculty 
Developrrfent Network and the New Jersey County College 
Project on General Education, a statewide effort of New 
Jersey community colleges to define and assess their student 
development outcomes. Dr. Gardiner’s scholarly work focus- 
es on improving the quality of students' learning in higher 
education, and he is the author of Planning for Assessment: 
Mission Statements, Goals, and Objectives. Gardiner has been 
a member of the board of directors of the Professional and 
Organizational Development Network in Higher Education 
and serves as a consultant to colleges and universities and a 
presenter at conferences around the country. 
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